00010000:00010000:2.0F:1789892519.714615:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892520.738623:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892520.738677:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789892520.738734:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915822336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892520.738817:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1789892520.738861:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915822336 00000100:00100000:3.0:1789892520.738878:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915822336 00000100:00100000:3.0:1789892520.738930:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789892520.738940:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915822336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789892520.738973:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789892520.739025:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915822336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892520.739032:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789892520.739080:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915822336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0F:1789892521.250636:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915822464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892521.250721:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.250757:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915822464 00000100:00100000:3.0:1789892521.250766:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915822464 00000100:00100000:3.0:1789892521.250817:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789892521.250827:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915822464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789892521.250858:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:3.0:1789892521.250906:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915822464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892521.250913:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789892521.250937:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915822464:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789892521.276796:0:213551:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd36ed8490 20000000:00000080:3.0:1789892521.276813:0:213551:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90688354f800 uarg=0000000000000000 00000040:00100000:3.0:1789892521.277541:0:213551:0:(llog.c:1072:llog_reverse_process()) index 143 : idx 137 00000040:00100000:3.0:1789892521.277552:0:213551:0:(llog.c:1072:llog_reverse_process()) index 135 : idx 93 20000000:01000000:3.0:1789892521.277556:0:213551:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 132 cmd:0xce021 lustre.qpool1 lustre-OST0000_UUID 20000000:01000000:3.0:1789892521.277571:0:213551:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892521.277830:0:213552:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 131 marker 142 1->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892521.277886:0:213552:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 133 marker 142 2->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892521.277907:0:213552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 144 count 141 00000040:00080000:1.0:1789892521.278041:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].144, 224 off34344 20000000:01000000:1.0:1789892521.278056:0:213551:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892521.278074:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].145, 128 off34472 00000040:00080000:1.0:1789892521.278093:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].146, 224 off34696 20000000:01000000:1.0:1789892521.278108:0:213551:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892521.278365:0:213553:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 154 marker 143 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892521.278386:0:213553:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 156 marker 143 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892521.278402:0:213553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 166 count 163 00000040:00080000:1.0:1789892521.278482:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].166, 224 off38488 20000000:01000000:1.0:1789892521.278508:0:213551:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892521.278521:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].167, 136 off38624 00000040:00080000:1.0:1789892521.278532:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].168, 224 off38848 20000000:01000000:1.0:1789892521.278540:0:213551:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892521.278762:0:213554:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 154 marker 144 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892521.278793:0:213554:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 156 marker 144 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892521.278919:0:213554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 166 count 163 00000040:00080000:1.0:1789892521.279006:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].166, 224 off38488 20000000:01000000:1.0:1789892521.279014:0:213551:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892521.279024:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].167, 136 off38624 00000040:00080000:1.0:1789892521.279034:0:213551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].168, 224 off38848 10000000:01000000:1.0:1789892521.279043:0:213551:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892521.279058:0:213551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279078:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279084:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279089:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279093:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279103:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279107:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279112:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279116:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279120:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279127:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279132:0:213551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279137:0:213551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279167:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279178:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 9 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279197:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5404380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822592:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892521.279284:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279291:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 9 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279298:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822720:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892521.279322:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279328:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 23 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279334:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822848:0@lo:104: 00000100:00100000:1.0:1789892521.279363:0:213551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892521.279394:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279401:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279408:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822976:0@lo:104: 00000100:00100000:2.0:1789892521.279409:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915822848 00000100:00100000:2.0:1789892521.279418:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915822848 00000100:00100000:1.0:1789892521.279424:0:213551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892521.279449:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279465:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 23 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.279467:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915822976 00000100:00100000:2.0:1789892521.279473:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915822976 00000100:00100000:1.0:1789892521.279478:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823104:0@lo:104: 00000100:00100000:3.0:1789892521.279485:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789892521.279544:0:213551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892521.279574:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279580:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279587:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823232:0@lo:104: 00000100:00100000:1.0:1789892521.279604:0:213551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892521.279622:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279628:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 23 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279633:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823360:0@lo:104: 00000100:00100000:1.0:1789892521.279646:0:213551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892521.279654:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279659:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279664:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823488:0@lo:104: 00010000:00010000:1.0:1789892521.279709:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279716:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 23 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279721:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823616:0@lo:104: 00010000:00010000:1.0:1789892521.279735:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279742:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279748:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823744:0@lo:104: 00010000:00010000:1.0:1789892521.279772:0:213551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.279781:0:213551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 23 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279791:0:213551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823872:0@lo:104: 00000100:00100000:1.0:1789892521.279810:0:213551:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892521.279851:0:193632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892521.279871:0:193632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.279887:0:193632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.279903:0:193632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.279918:0:193632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.279926:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823104 00000100:00100000:1.0:1789892521.279931:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823104 00000100:00100000:3.0:1789892521.279956:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213551:x1876834915822848:12345-0@lo:104: 00000100:00100000:2.0:1789892521.279958:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823232 00000100:00100000:0.0F:1789892521.279958:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823360 00000100:00100000:1.0:1789892521.279961:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823488 00000100:00100000:2.0:1789892521.279966:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823232 00000100:00100000:0.0:1789892521.279969:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823360 00010000:00010000:3.0:1789892521.279974:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.279975:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823488 00000100:00100000:2.0:1789892521.279987:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823616 00000100:00100000:0.0:1789892521.279987:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823744 00000100:00100000:2.0:1789892521.279993:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823616 00000100:00100000:0.0:1789892521.279993:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823744 00000100:00100000:1.0:1789892521.280005:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915823872 00000100:00100000:1.0:1789892521.280012:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915823872 00000100:00100000:2.0:1789892521.280021:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789892521.280028:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789892521.280032:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+11:213551:x1876834915822976:12345-0@lo:104: 00000100:00100000:0.0:1789892521.280035:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+11:213551:x1876834915823104:12345-0@lo:104: 00010000:00010000:2.0:1789892521.280044:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280044:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.280047:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892521.280051:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789892521.280062:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+11:213551:x1876834915822848:12345-0@lo:104: Request processed in 108us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.280070:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+11:213551:x1876834915823232:12345-0@lo:104: 00000100:00100000:3.0:1789892521.280077:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:1.0:1789892521.280084:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.280105:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00010000:00010000:2.0:1789892521.280109:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789892521.280115:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892521.280119:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af2c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+10:213551:x1876834915823360:12345-0@lo:104: 00000100:00100000:2.0:1789892521.280120:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+10:213551:x1876834915822976:12345-0@lo:104: Request processed in 88us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892521.280125:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+10:213551:x1876834915823104:12345-0@lo:104: Request processed in 89us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892521.280135:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00010000:00010000:3.0:1789892521.280136:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280140:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789892521.280143:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789892521.280155:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+9:213551:x1876834915823232:12345-0@lo:104: Request processed in 88us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892521.280156:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789892521.280166:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789892521.280167:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+8:213551:x1876834915823488:12345-0@lo:104: 00000100:00100000:1.0:1789892521.280173:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00010000:2.0:1789892521.280177:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.280177:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+8:213551:x1876834915823616:12345-0@lo:104: 00010000:00010000:0.0:1789892521.280185:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.280193:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789892521.280197:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789892521.280205:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+7:213551:x1876834915823744:12345-0@lo:104: 00010000:00010000:1.0:1789892521.280215:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280218:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00010000:00010000:0.0:1789892521.280219:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789892521.280228:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+7:213551:x1876834915823488:12345-0@lo:104: Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892521.280228:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+7:213551:x1876834915823616:12345-0@lo:104: Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892521.280236:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789892521.280240:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789892521.280256:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789892521.280268:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213551:x1876834915823872:12345-0@lo:104: 00000100:00100000:3.0:1789892521.280270:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af2c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213551:x1876834915823360:12345-0@lo:104: Request processed in 153us (617us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892521.280271:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00010000:00010000:2.0:1789892521.280275:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789892521.280280:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.280286:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213551:x1876834915823744:12345-0@lo:104: Request processed in 77us (379us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892521.280287:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.280292:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789892521.280307:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:2.0:1789892521.280308:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801e00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892521.280315:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280325:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280330:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 10000000:00010000:2.0:1789892521.280333:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.280337:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213551:x1876834915823872:12345-0@lo:104: Request processed in 73us (416us total) trans 0 rc 0/0 10000000:01000000:2.0:1789892521.280340:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892521.280350:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789892521.280358:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822848:0@lo:104: 00010000:00010000:3.0:1789892521.280373:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00000100:00100000:1.0:1789892521.280373:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822976:0@lo:104: 00010000:00010000:2.0:1789892521.280374:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280376:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789892521.280383:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280386:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.280389:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823104:0@lo:104: 00010000:00010000:2.0:1789892521.280390:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892521.280405:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823232:0@lo:104: 00010000:00010000:3.0:1789892521.280407:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800c00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892521.280409:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801200 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:2.0:1789892521.280414:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892521.280416:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892521.280417:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.280420:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823360:0@lo:104: 00010000:00010000:2.0:1789892521.280431:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd00212fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fb5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.280435:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823488:0@lo:104: 00010000:00010000:0.0:1789892521.280440:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280452:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:1.0:1789892521.280458:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823616:0@lo:104: 00010000:00010000:2.0:1789892521.280459:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892521.280463:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.280471:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.280473:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823744:0@lo:104: 10000000:01000000:0.0:1789892521.280476:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892521.280481:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915823872:0@lo:104: 00010000:00010000:2.0:1789892521.280516:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801c00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892521.280516:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892521.280520:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280524:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892521.280528:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789892521.280529:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280535:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892521.280543:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280544:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280546:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892521.280553:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892521.280557:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892521.280557:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd00212f92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f99 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280569:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280575:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:00010000:1.0:1789892521.280576:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280579:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280581:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892521.280595:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892521.280598:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892521.280608:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280608:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892521.280612:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280619:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00212f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f8b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280619:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280622:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280642:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892521.280645:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280647:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892521.280652:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280653:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892521.280654:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892521.280669:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892521.280688:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f7d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280690:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892521.280691:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280710:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892521.280714:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1789892521.280716:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280722:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280724:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280733:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892521.280741:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892521.280749:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd00212f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f61 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280750:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892521.280753:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892521.280756:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280767:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789892521.280768:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892521.280770:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280774:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280776:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280790:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.280796:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892521.280798:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892521.280800:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892521.280803:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280806:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892521.280809:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280815:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892521.280821:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892521.280840:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00212fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fa7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280841:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f6f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.280841:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280843:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280868:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892521.280868:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.280870:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892521.280874:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892521.280877:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892521.280878:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892521.280879:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892521.280879:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892521.280882:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892521.280890:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892521.280891:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f53 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.280903:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892521.280903:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892521.280904:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915824000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892521.280904:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.280905:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892521.280911:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892521.280916:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892521.280925:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.280934:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915824384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892521.280934:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00212f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212f45 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.280936:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915824128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892521.280942:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892521.280961:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892521.280964:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892521.280967:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892521.280980:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915824256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892521.280984:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915824512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892521.280992:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.281015:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824000 00000100:00100000:3.0:1789892521.281019:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824000 00000100:00100000:2.0:1789892521.281027:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.281027:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915824640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892521.281028:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892521.281041:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 24 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.281062:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915825024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892521.281063:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915824768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892521.281066:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824128 00000100:00100000:1.0:1789892521.281070:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.281072:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824128 00010000:00010000:3.0:1789892521.281097:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 25 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.281106:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892521.281112:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824512 00000100:00100000:2.0:1789892521.281117:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824512 00000100:00100000:3.0:1789892521.281118:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824256 00000100:00100000:3.0:1789892521.281123:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824256 00010000:00010000:3.0:1789892521.281142:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 27 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281149:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 27 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.281157:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824640 00000100:00100000:3.0:1789892521.281159:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824768 00000100:00100000:0.0:1789892521.281162:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824640 00000100:00100000:3.0:1789892521.281165:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824768 00000100:00100000:2.0:1789892521.281175:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789892521.281184:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:0.0:1789892521.281184:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 29 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.281186:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 29 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.281188:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3620:x1876834915824000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892521.281205:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892521.281209:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892521.281211:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838080 00010000:00010000:2.0:1789892521.281215:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 29 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281217:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838080 00010000:00010000:2.0:1789892521.281231:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 29 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.281231:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838208 00010000:00010000:3.0:1789892521.281236:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 10 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.281237:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789892521.281238:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838208 00000100:00100000:0.0:1789892521.281253:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3621:x1876834915824128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892521.281260:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 11 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281261:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836c00/0x5c4f93dd00212fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212fae expref: 29 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.281265:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892521.281267:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00010000:00010000:0.0:1789892521.281274:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 29 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281282:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3622:x1876834915824256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892521.281288:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892521.281293:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00010000:00010000:3.0:1789892521.281297:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892521.281298:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 28 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.281305:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 28 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.281307:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3620:x1876834915824512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892521.281322:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3620:x1876834915824000:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (382us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892521.281323:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892521.281323:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd00212f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f92 expref: 28 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.281325:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 28 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.281332:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 28 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.281342:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:0.0:1789892521.281352:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892521.281360:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe200/0x5c4f93dd00212f8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f84 expref: 26 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.281365:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 26 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.281372:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00010000:00010000:3.0:1789892521.281381:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892521.281385:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915824768:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892521.281385:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3621:x1876834915824128:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (399us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892521.281389:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837000/0x5c4f93dd00212f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f5a expref: 25 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281399:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892521.281402:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00010000:00010000:2.0:1789892521.281406:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 24 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.281407:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892521.281420:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.281421:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1789892521.281432:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915824640:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892521.281434:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3622:x1876834915824256:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (409us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892521.281437:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd00212f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f68 expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.281443:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3620:x1876834915824512:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (420us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892521.281445:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892521.281453:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00010000:00010000:0.0:1789892521.281454:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 23 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.281464:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00010000:00010000:2.0:1789892521.281469:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892521.281472:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 21 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281482:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 413 00010000:00010000:0.0:1789892521.281487:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd00212fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212fa0 expref: 20 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892521.281510:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 414 00000100:00100000:1.0:1789892521.281523:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925838208:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789892521.281525:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925838080:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789892521.281534:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3622:x1876834915824768:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (429us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892521.281538:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892521.281540:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892521.281544:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892521.281545:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:1.0:1789892521.281546:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 11 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.281550:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 11 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892521.281568:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 11 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.281576:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915824640:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892521.281584:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892521.281585:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 11 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.281585:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1789892521.281601:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824384 00010000:00010000:3.0:1789892521.281605:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892521.281606:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892521.281606:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824384 00000100:00100000:2.0:1789892521.281614:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915824896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892521.281626:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 18 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281638:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925838080:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 144us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.281639:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925838208:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 119us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892521.281646:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789892521.281650:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.281662:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 413 00000100:00100000:0.0:1789892521.281662:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3619:x1876834915824384:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892521.281682:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 414 00010000:00010000:0.0:1789892521.281691:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892521.281700:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915824896 00010000:00010000:0.0:1789892521.281700:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 18 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.281704:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915824896 00010000:00010000:0.0:1789892521.281711:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 19 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281720:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 19 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.281724:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837600/0x5c4f93dd00212f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f76 expref: 19 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892521.281737:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892521.281741:0:213551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd00212fc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a581 expref: 9 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.281753:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1789892521.281757:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5404380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822592:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892521.281768:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3619:x1876834915824896:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892521.281771:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915824128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892521.281776:0:213551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffe00/0x5c4f93dd00212fbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a57a expref: 8 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281779:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892521.281783:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3619:x1876834915824384:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (199us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892521.281787:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 18 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281793:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915824640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892521.281801:0:213551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213551:1876834915822720:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892521.281801:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:2.0:1789892521.281806:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 18 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281822:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837a00/0x5c4f93dd00212f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f4c expref: 17 pid: 189433 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.281834:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892521.281848:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892521.281873:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3619:x1876834915824896:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892521.281875:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825024 00000100:00100000:0.0:1789892521.281879:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825024 00000100:00100000:2.0:1789892521.281882:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:1.0:1789892521.281891:0:213551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281892:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915824000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892521.281896:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 17 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281909:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915824512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892521.281938:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789892521.281950:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3620:x1876834915825024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892521.281959:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892521.281965:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 16 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281968:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915824384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892521.281983:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915824256:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892521.281984:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 16 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892521.281992:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915824896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892521.282000:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd00212f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212f3e expref: 16 pid: 189432 timeout: 3446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892521.282003:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915824768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892521.282013:0:189426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282022:0:189426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282036:0:189426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282046:0:189426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282054:0:189426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282061:0:189426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282065:0:189426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800a00 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:2.0:1789892521.282073:0:189426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282079:0:189426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282093:0:189426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892521.282100:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892521.282115:0:213551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892521.282123:0:213551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.282128:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3620:x1876834915825024:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (283us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892521.282133:0:213551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800a00/0x5c4f93dd00212fca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892521.282139:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789892521.282157:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915825024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892521.762657:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915825408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892521.762697:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915825152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892521.762705:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915825536:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.762757:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892521.762758:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.762784:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915825664:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.762809:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915826048:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.762813:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825536 00000100:00100000:1.0:1789892521.762819:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892521.762819:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915825920:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.762821:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825536 00000100:00100000:2.0:1789892521.762841:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.762851:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915826176:0@lo:400:kworker.0 00000100:00100000:0.0:1789892521.762864:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892521.762873:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915826560:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.762874:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789892521.762884:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.762890:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915825536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892521.762891:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876834915826432:0@lo:400:kworker.0 00000100:00100000:1.0:1789892521.762907:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1876834915826688:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.762910:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892521.762941:0:190946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825408 00000100:00100000:0.0:1789892521.762947:0:190946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825408 00000100:00100000:1.0:1789892521.762961:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892521.762973:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826048 00000100:00100000:2.0:1789892521.762978:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826048 00000100:00100000:3.0:1789892521.762985:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915825536:12345-0@lo:400:kworker.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892521.762992:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789892521.763007:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789892521.763015:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825664 00000100:00100000:2.0:1789892521.763019:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826560 00000100:00100000:1.0:1789892521.763020:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825664 00000100:00100000:0.0:1789892521.763021:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915825408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892521.763022:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826688 00000100:00100000:2.0:1789892521.763024:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826560 00000100:00100000:3.0:1789892521.763028:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826688 00002000:00000024:0.0:1789892521.763055:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892521.763060:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789892521.763069:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825920 00000100:00100000:2.0:1789892521.763071:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915826048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763075:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789892521.763076:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825920 00000100:00100000:3.0:1789892521.763087:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915826560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892521.763114:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826176 00000100:00100000:0.0:1789892521.763118:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915825408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.763119:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826176 00000100:00100000:2.0:1789892521.763126:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915826048:12345-0@lo:400:kworker.0 Request processed in 56us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892521.763133:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789892521.763139:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789892521.763140:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915826560:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.763141:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789892521.763155:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915825664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763161:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789892521.763162:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789892521.763170:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789892521.763175:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915825920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763182:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876834915826688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892521.763210:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915825664:12345-0@lo:400:kworker.0 Request processed in 59us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.763219:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789892521.763226:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915825920:12345-0@lo:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892521.763228:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915826560:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763238:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876834915826688:12345-0@lo:400:kworker.0 Request processed in 57us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.763243:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789892521.763248:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915825536:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763249:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789892521.763255:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789892521.763258:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915826176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763273:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915826048:0@lo:400:kworker.0 00010000:00010000:2.0:1789892521.763293:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789892521.763295:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789892521.763301:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789892521.763304:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892521.763313:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915826176:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00080000:0.0:1789892521.763315:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892521.763322:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789892521.763332:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892521.763338:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892521.763350:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826432 00000100:00100000:1.0:1789892521.763355:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826432 00000100:00100000:0.0:1789892521.763365:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1876834915826944:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763367:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915825280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892521.763385:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825152 00000100:00100000:3.0:1789892521.763390:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825152 00000100:00100000:1.0:1789892521.763394:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1789892521.763407:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3622:x1876834915826432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892521.763412:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892521.763414:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.763430:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825280 00000100:00100000:3.0:1789892521.763433:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825280 00000100:00100000:2.0:1789892521.763446:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915825792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892521.763464:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915825408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892521.763473:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789892521.763475:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3622:x1876834915826432:12345-0@lo:400:kworker.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892521.763486:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.763487:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915825152:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892521.763513:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789892521.763515:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915825920:0@lo:400:kworker.0 00002000:00000024:3.0:1789892521.763516:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892521.763533:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826944 00000100:00100000:1.0:1789892521.763538:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826944 00000100:00100000:0.0:1789892521.763538:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876834915826432:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763550:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915826304:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763564:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915825152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.763576:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789892521.763581:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.763589:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789892521.763595:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876834915826944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763605:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915826816:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763611:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915825792 00000100:00100000:0.0:1789892521.763614:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915825664:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763616:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915825792 00000100:00100000:0.0:1789892521.763637:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915826176:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763643:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789892521.763647:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892521.763657:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915825280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892521.763659:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876834915826944:12345-0@lo:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00010000:00080000:0.0:1789892521.763677:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90689ae85500 x1876834915826688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1789892521.763687:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892521.763688:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789892521.763691:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1876834915826688:0@lo:400:kworker.0 00000100:00100000:2.0:1789892521.763698:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915825152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892521.763713:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826816 00000100:00100000:1.0:1789892521.763718:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826816 00000100:00100000:3.0:1789892521.763743:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915825280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (331us total) trans 0 rc 0/0 00010000:00080000:0.0:1789892521.763745:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90689ae85c00 x1876834915826944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892521.763750:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915825280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892521.763756:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789892521.763759:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789892521.763768:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1876834915826944:0@lo:400:kworker.0 00000100:00100000:1.0:1789892521.763772:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915826816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763783:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789892521.763793:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915825792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892521.763799:0:190942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915826304 00002000:00000024:3.0:1789892521.763803:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892521.763804:0:190942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915826304 00000100:00100000:1.0:1789892521.763825:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915826816:12345-0@lo:400:kworker.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892521.763835:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789892521.763842:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915825792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892521.763842:0:190942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00080000:0.0:1789892521.763844:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789892521.763852:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892521.763858:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789892521.763858:0:190942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915826304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789892521.763858:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892521.763895:0:190942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915826304:12345-0@lo:400:kworker.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892521.763899:0:190942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789892521.763904:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915826304:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763914:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915826816:0@lo:400:kworker.0 00000100:00100000:3.0:1789892521.763925:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915825792:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1789892522.722593:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892522.722620:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 144 10000000:01000000:2.0:1789892522.722627:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892522.722698:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.722709:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.722719:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892522.722740:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.722832:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.722872:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.722903:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827072 00000100:00100000:0.0:1789892522.722912:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827072 00000100:00100000:0.0:1789892522.722967:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:0.0:1789892522.722978:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915827072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.722994:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.723024:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00212fd1 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.723058:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.723071:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.723081:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892522.723130:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915827072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.723136:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1789892522.723171:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892522.723187:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.723197:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892522.723271:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.723300:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.723321:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.723357:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827200 00000100:00100000:0.0:1789892522.723363:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827200 00000100:00100000:0.0:1789892522.723394:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:0.0:1789892522.723402:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915827200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.723542:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915827200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.723552:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1789892522.723573:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.723609:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.723666:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.723691:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.723710:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827328 00000100:00100000:0.0:1789892522.723714:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827328 00000100:00100000:0.0:1789892522.723737:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:0.0:1789892522.723745:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915827328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.723828:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915827328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.723835:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:2.0:1789892522.723856:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.724148:0:213555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213555:1876834915827456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.724186:0:213555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.724205:0:213555:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.724223:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827456 00000100:00100000:0.0:1789892522.724228:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827456 00000100:00100000:0.0:1789892522.724262:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1789892522.724270:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213555:x1876834915827456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.724358:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213555:x1876834915827456:12345-0@lo:502:llog_process_th.0 Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.724367:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:2.0:1789892522.724389:0:213555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213555:1876834915827456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.724426:0:213555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213555:1876834915827584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.724451:0:213555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.724465:0:213555:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.724474:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827584 00000100:00100000:0.0:1789892522.724478:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827584 00000100:00100000:0.0:1789892522.724511:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1789892522.724516:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213555:x1876834915827584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.724588:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213555:x1876834915827584:12345-0@lo:502:llog_process_th.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.724595:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:2.0:1789892522.724613:0:213555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213555:1876834915827584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892522.724639:0:213555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892522.724735:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892522.724758:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892522.724765:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.724773:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.724780:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892522.724781:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789892522.724783:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892522.724804:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.724809:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.724815:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.724825:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.724852:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.724874:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.724897:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827712 00000100:00100000:0.0:1789892522.724901:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827712 00000100:00100000:0.0:1789892522.724923:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1789892522.724927:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915827712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.724932:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.724938:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00212fdf expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.724950:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.724957:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.724962:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892522.724989:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915827712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.724999:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1789892522.725035:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892522.725048:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.725055:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.725109:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.725128:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.725142:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.725162:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827840 00000100:00100000:0.0:1789892522.725168:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827840 00000100:00100000:0.0:1789892522.725195:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:0.0:1789892522.725201:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915827840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.725268:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915827840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.725276:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:1.0:1789892522.725305:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.725325:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.725352:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.725366:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.725392:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915827968 00000100:00100000:0.0:1789892522.725396:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915827968 00000100:00100000:0.0:1789892522.725415:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1789892522.725419:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915827968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.725486:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915827968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.725506:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:1.0:1789892522.725517:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915827968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892522.726364:0:213556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:1.0:1789892522.726449:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:1.0:1789892522.726472:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892522.726477:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.726483:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.726529:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892522.726532:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 144 10000000:01000000:1.0:1789892522.726535:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892522.726562:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.726573:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.726596:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.726610:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.726638:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.726703:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.726736:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828096 00000100:00100000:0.0:1789892522.726741:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828096 00000100:00100000:0.0:1789892522.726764:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1789892522.726768:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915828096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.726774:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.726781:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00212fed expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.726793:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.726800:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.726811:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892522.726838:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915828096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.726844:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:1.0:1789892522.726868:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892522.726881:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.726888:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.726930:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.726950:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.726966:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.726986:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828224 00000100:00100000:0.0:1789892522.726991:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828224 00000100:00100000:0.0:1789892522.727012:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1789892522.727017:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915828224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.727089:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915828224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.727094:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:1.0:1789892522.727117:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.727136:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.727163:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.727176:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.727193:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828352 00000100:00100000:0.0:1789892522.727199:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828352 00000100:00100000:0.0:1789892522.727221:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1789892522.727225:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915828352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.727291:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915828352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.727298:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:1.0:1789892522.727304:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892522.727509:0:213557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213557:1876834915828480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.727563:0:213557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892522.727596:0:213557:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dae1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.727601:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828480 00000100:00100000:0.0:1789892522.727605:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828480 00000100:00100000:0.0:1789892522.727626:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1789892522.727632:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213557:x1876834915828480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.727721:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213557:x1876834915828480:12345-0@lo:502:llog_process_th.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.727726:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00100000:3.0:1789892522.727761:0:213557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213557:1876834915828480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.727815:0:213557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213557:1876834915828608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.727878:0:213557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892522.727905:0:213557:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dae1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.727920:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828608 00000100:00100000:0.0:1789892522.727927:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828608 00000100:00100000:0.0:1789892522.727955:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:0.0:1789892522.727961:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213557:x1876834915828608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.728027:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213557:x1876834915828608:12345-0@lo:502:llog_process_th.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.728034:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:3.0:1789892522.728050:0:213557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213557:1876834915828608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892522.728099:0:213557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892522.728155:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892522.728175:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892522.728179:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.728185:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.728190:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892522.728191:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789892522.728192:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892522.728203:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.728208:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.728213:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.728228:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.728248:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.728260:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.728280:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828736 00000100:00100000:0.0:1789892522.728285:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828736 00000100:00100000:0.0:1789892522.728307:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:0.0:1789892522.728311:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915828736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.728316:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.728323:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00212ffb expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.728334:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.728340:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.728345:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836600, rc 0) 00000100:00100000:0.0:1789892522.728371:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915828736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.728375:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1789892522.728392:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892522.728402:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.728408:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.728434:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.728451:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.728463:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.728472:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828864 00000100:00100000:0.0:1789892522.728475:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828864 00000100:00100000:0.0:1789892522.728515:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:0.0:1789892522.728522:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915828864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.728608:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915828864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.728614:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:1.0:1789892522.728623:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.728656:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.728685:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892522.728733:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915828992 00000100:00100000:1.0:1789892522.728736:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.728739:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915828992 00000100:00100000:0.0:1789892522.728768:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:0.0:1789892522.728773:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915828992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.728838:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915828992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.728845:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:1.0:1789892522.728859:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915828992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892522.729492:0:213558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:2.0:1789892522.729582:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892522.729605:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892522.729611:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.729622:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892522.729632:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892522.729633:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 144 10000000:01000000:2.0:1789892522.729635:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892522.729662:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.729668:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.729682:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892522.729702:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.729723:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.729743:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.729761:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829120 00000100:00100000:0.0:1789892522.729765:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829120 00000100:00100000:0.0:1789892522.729785:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:0.0:1789892522.729789:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915829120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.729794:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.729800:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213009 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.729811:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.729817:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.729821:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837000, rc 0) 00000100:00100000:0.0:1789892522.729848:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915829120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.729865:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:2.0:1789892522.729870:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892522.729882:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.729888:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892522.729922:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.729949:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.729967:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.729972:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829248 00000100:00100000:0.0:1789892522.729976:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829248 00000100:00100000:0.0:1789892522.729993:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:0.0:1789892522.729997:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915829248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.730046:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915829248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.730051:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1789892522.730070:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.730094:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.730122:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.730136:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.730145:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829376 00000100:00100000:0.0:1789892522.730150:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829376 00000100:00100000:0.0:1789892522.730179:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:0.0:1789892522.730187:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915829376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.730247:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915829376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.730255:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00100000:2.0:1789892522.730267:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.730449:0:213559:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213559:1876834915829504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.730475:0:213559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892522.730516:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829504 00000100:00100000:0.0:1789892522.730521:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829504 00000100:00100000:2.0:1789892522.730545:0:213559:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.730559:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1789892522.730569:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213559:x1876834915829504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.730627:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213559:x1876834915829504:12345-0@lo:502:llog_process_th.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.730633:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:2.0:1789892522.730662:0:213559:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213559:1876834915829504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.730694:0:213559:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213559:1876834915829632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.730719:0:213559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.730732:0:213559:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.730741:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829632 00000100:00100000:0.0:1789892522.730745:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829632 00000100:00100000:0.0:1789892522.730764:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:0.0:1789892522.730768:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213559:x1876834915829632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.730824:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213559:x1876834915829632:12345-0@lo:502:llog_process_th.0 Request processed in 55us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.730830:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:2.0:1789892522.730838:0:213559:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213559:1876834915829632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892522.730857:0:213559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892522.730904:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892522.730923:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892522.730927:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.730942:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.730947:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892522.730948:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 166 10000000:01000000:1.0:1789892522.730950:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892522.730960:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.730965:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.730971:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.730979:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.730999:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.731012:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.731022:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829760 00000100:00100000:0.0:1789892522.731026:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829760 00000100:00100000:0.0:1789892522.731046:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:0.0:1789892522.731050:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915829760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.731055:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.731062:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213017 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.731073:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.731079:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.731084:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837c00, rc 0) 00000100:00100000:0.0:1789892522.731109:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915829760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.731114:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1789892522.731136:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892522.731145:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.731150:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.731176:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.731194:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.731213:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.731222:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915829888 00000100:00100000:0.0:1789892522.731226:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915829888 00000100:00100000:0.0:1789892522.731249:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:0.0:1789892522.731258:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915829888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.731327:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915829888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892522.731345:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915829888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.731347:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1789892522.731375:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.731415:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892522.731435:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830016 00000100:00100000:1.0:1789892522.731444:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.731447:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830016 00000100:00100000:0.0:1789892522.731468:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1789892522.731473:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915830016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.731559:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915830016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.731567:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1789892522.731575:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892522.731741:0:213560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213560:1876834915830144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.731777:0:213560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892522.731802:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830144 00000100:00100000:0.0:1789892522.731806:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830144 00000100:00100000:3.0:1789892522.731809:0:213560:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dae16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.731833:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1789892522.731839:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213560:x1876834915830144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.731924:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213560:x1876834915830144:12345-0@lo:502:llog_process_th.0 Request processed in 85us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.731930:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:3.0:1789892522.731951:0:213560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213560:1876834915830144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892522.731974:0:213560:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892522.731982:0:213560:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892522.731984:0:213560:0:(obd_config.c:1561:class_process_config()) marker 156 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:3.0:1789892522.731988:0:213560:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892522.732002:0:213560:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:3.0:1789892522.732016:0:213560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213560:1876834915830272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.732042:0:213560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892522.732074:0:213560:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dae16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.732084:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830272 00000100:00100000:0.0:1789892522.732089:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830272 00000100:00100000:0.0:1789892522.732111:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1789892522.732115:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213560:x1876834915830272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.732200:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213560:x1876834915830272:12345-0@lo:502:llog_process_th.0 Request processed in 82us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.732208:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:3.0:1789892522.732210:0:213560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213560:1876834915830272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892522.732232:0:213560:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892522.732236:0:213560:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892522.732238:0:213560:0:(obd_config.c:1561:class_process_config()) marker 156 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892522.732240:0:213560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 169 count 166 00000020:01000000:1.0:1789892522.732280:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 166-168 (rc=0) 10000000:01000000:1.0:1789892522.732303:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892522.732307:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.732313:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.732318:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892522.732319:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 144 10000000:01000000:1.0:1789892522.732321:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892522.732331:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.732336:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.732341:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.732349:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.732369:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.732388:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.732400:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830400 00000100:00100000:0.0:1789892522.732403:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830400 00000100:00100000:0.0:1789892522.732423:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:0.0:1789892522.732429:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915830400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.732439:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.732445:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213025 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.732455:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.732461:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.732466:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837a00, rc 0) 00000100:00100000:0.0:1789892522.732517:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915830400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892522.732519:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.732532:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00010000:00010000:1.0:1789892522.732537:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.732544:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.732574:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.732591:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.732611:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.732616:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830528 00000100:00100000:0.0:1789892522.732620:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830528 00000100:00100000:0.0:1789892522.732653:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:0.0:1789892522.732661:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915830528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.732732:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915830528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.732739:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1789892522.732743:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.732768:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.732798:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.732812:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.732822:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830656 00000100:00100000:0.0:1789892522.732825:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830656 00000100:00100000:0.0:1789892522.732844:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:0.0:1789892522.732853:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915830656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.732927:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915830656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892522.732933:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915830656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.732945:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:0.0:1789892522.733116:0:213561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213561:1876834915830784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.733164:0:213561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892522.733186:0:213561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069914fdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892522.733195:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830784 00000100:00100000:2.0:1789892522.733201:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830784 00000100:00100000:2.0:1789892522.733228:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00100000:2.0:1789892522.733234:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213561:x1876834915830784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892522.733306:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213561:x1876834915830784:12345-0@lo:502:llog_process_th.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892522.733313:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00100000:0.0:1789892522.733337:0:213561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213561:1876834915830784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.733376:0:213561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213561:1876834915830912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.733402:0:213561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892522.733417:0:213561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069914fdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892522.733445:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915830912 00000100:00100000:3.0:1789892522.733451:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915830912 00000100:00100000:3.0:1789892522.733484:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00100000:3.0:1789892522.733551:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213561:x1876834915830912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.733635:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213561:x1876834915830912:12345-0@lo:502:llog_process_th.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.733657:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00100000:0.0:1789892522.733663:0:213561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213561:1876834915830912:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892522.733704:0:213561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892522.733773:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892522.733795:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892522.733799:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.733811:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.733817:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892522.733819:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 166 10000000:01000000:1.0:1789892522.733821:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892522.733839:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.733845:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.733851:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.733860:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.733881:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.733902:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892522.733914:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831040 00000100:00100000:2.0:1789892522.733921:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831040 00000100:00100000:2.0:1789892522.733958:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:2.0:1789892522.733968:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915831040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892522.733977:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892522.733986:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213033 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.733999:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.734006:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892522.734021:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff000, rc 0) 00000100:00100000:2.0:1789892522.734053:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915831040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892522.734059:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1789892522.734075:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892522.734086:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.734092:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.734120:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.734154:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.734167:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892522.734184:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831168 00000100:00100000:3.0:1789892522.734188:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831168 00000100:00100000:3.0:1789892522.734211:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:3.0:1789892522.734217:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915831168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892522.734277:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915831168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.734284:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1789892522.734284:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.734312:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.734341:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.734354:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892522.734369:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831296 00000100:00100000:2.0:1789892522.734373:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831296 00000100:00100000:2.0:1789892522.734395:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:2.0:1789892522.734400:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915831296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.734475:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915831296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892522.734481:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892522.734482:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:1.0:1789892522.734671:0:213562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213562:1876834915831424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892522.734708:0:213562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.734726:0:213562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892522.734736:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831424 00000100:00100000:3.0:1789892522.734740:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831424 00000100:00100000:3.0:1789892522.734761:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1789892522.734766:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213562:x1876834915831424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892522.734837:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213562:x1876834915831424:12345-0@lo:502:llog_process_th.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.734843:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:1.0:1789892522.734856:0:213562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213562:1876834915831424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892522.734881:0:213562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892522.734887:0:213562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892522.734888:0:213562:0:(obd_config.c:1561:class_process_config()) marker 155 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:1.0:1789892522.734893:0:213562:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789892522.734899:0:213562:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:2.0:1789892522.735152:0:213562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213562:1876834915831552:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789892522.735152:0:213563:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892522.735158:0:213563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:2.0:1789892522.735189:0:213562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892522.735210:0:213562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069838e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.735229:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831552 00000100:00100000:0.0:1789892522.735236:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831552 00000100:00100000:0.0:1789892522.735275:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:0.0:1789892522.735283:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213562:x1876834915831552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892522.735360:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213562:x1876834915831552:12345-0@lo:502:llog_process_th.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.735366:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:2.0:1789892522.735386:0:213562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213562:1876834915831552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892522.735406:0:213562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892522.735409:0:213562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892522.735411:0:213562:0:(obd_config.c:1561:class_process_config()) marker 155 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789892522.735413:0:213562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 169 count 166 00000020:01000000:1.0:1789892522.735461:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 166-168 (rc=0) 10000000:01000000:1.0:1789892522.735477:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892522.735481:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.735487:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892522.735514:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892522.735516:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:1.0:1789892522.735518:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892522.735530:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.735536:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.735542:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.735556:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.735577:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892522.735596:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831680 00000100:00100000:1.0:1789892522.735600:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892522.735601:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831680 00000100:00100000:3.0:1789892522.735627:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:3.0:1789892522.735633:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915831680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892522.735638:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892522.735658:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213041 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892522.735675:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892522.735708:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892522.735717:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fa00, rc 0) 00000100:00100000:3.0:1789892522.735750:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915831680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.735757:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:1.0:1789892522.735764:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892522.735778:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.735784:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892522.735813:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892522.735833:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892522.735848:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892522.735868:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915831808 00000100:00100000:0.0:1789892522.735874:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915831808 00000100:00100000:0.0:1789892522.735906:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:0.0:1789892522.735914:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915831808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.735963:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915831808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892522.735972:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915831808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.735972:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 10000000:01000000:1.0:1789892522.735996:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892522.736002:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892522.736008:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892522.767335:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892522.767395:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838336 00000100:00100000:3.0:1789892522.767405:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838336 00000100:00100000:3.0:1789892522.767454:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1791 00000100:00100000:3.0:1789892522.767462:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925838336:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892522.767477:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892522.767515:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a588 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892522.767547:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892522.767555:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892522.767563:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ee00, rc 0) 00000100:00100000:3.0:1789892522.767610:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925838336:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 150us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.767616:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1791 00000100:00100000:1.0:1789892522.768388:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892522.768435:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838464 00000100:00100000:0.0:1789892522.768439:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838464 00000100:00100000:0.0:1789892522.768467:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1792 00000100:00100000:0.0:1789892522.768476:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925838464:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892522.768605:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925838464:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 129us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.768613:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1792 00000100:00100000:1.0:1789892522.769283:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892522.769322:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838592 00000100:00100000:3.0:1789892522.769341:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838592 00000100:00100000:3.0:1789892522.769366:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1793 00000100:00100000:3.0:1789892522.769374:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925838592:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892522.769446:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925838592:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.769454:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1793 00000100:00100000:1.0:1789892522.770447:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892522.770506:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838720 00000100:00100000:0.0:1789892522.770510:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838720 00000100:00100000:0.0:1789892522.770538:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1794 00000100:00100000:0.0:1789892522.770546:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212796:x1876834925838720:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892522.770634:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212796:x1876834925838720:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.770654:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1794 00000100:00100000:1.0:1789892522.771260:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892522.771296:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838848 00000100:00100000:3.0:1789892522.771301:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838848 00000100:00100000:3.0:1789892522.771325:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1795 00000100:00100000:3.0:1789892522.771331:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212796:x1876834925838848:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892522.771390:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212796:x1876834925838848:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892522.771397:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1795 00000100:00100000:1.0:1789892522.772220:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892522.772281:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925838976 00000100:00100000:0.0:1789892522.772287:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925838976 00000100:00100000:0.0:1789892522.772323:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1796 00000100:00100000:0.0:1789892522.772335:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925838976:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892522.772345:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892522.772357:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a58f expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.772378:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.772390:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892522.772408:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892522.772441:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925838976:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892522.772450:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1796 00000100:00100000:1.0:1789892522.773081:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892522.773117:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839104 00000100:00100000:3.0:1789892522.773123:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839104 00000100:00100000:3.0:1789892522.773148:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1797 00000100:00100000:3.0:1789892522.773155:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925839104:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892522.773202:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925839104:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 47us (121us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892522.773208:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1797 00010000:00010000:3.0:1789892522.786659:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789892523.576370:0:213611:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffee49c6540 20000000:00000080:2.0:1789892523.576386:0:213611:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff906985fc3800 uarg=0000000000000000 00000040:00100000:2.0:1789892523.577192:0:213611:0:(llog.c:1072:llog_reverse_process()) index 146 : idx 137 00000040:00100000:2.0:1789892523.577205:0:213611:0:(llog.c:1072:llog_reverse_process()) index 135 : idx 93 20000000:01000000:2.0:1789892523.577208:0:213611:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 135 cmd:0xce021 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:2.0:1789892523.577224:0:213611:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892523.577561:0:213612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 134 marker 145 1->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892523.577622:0:213612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 137 marker 145 2->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892523.577665:0:213612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000040:00080000:1.0:1789892523.577786:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].147, 224 off34920 20000000:01000000:1.0:1789892523.577799:0:213611:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892523.577809:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].148, 128 off35048 00000040:00080000:1.0:1789892523.577819:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].149, 224 off35272 20000000:01000000:1.0:1789892523.577829:0:213611:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892523.578056:0:213613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 157 marker 146 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892523.578075:0:213613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 146 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892523.578090:0:213613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 169 count 166 00000040:00080000:1.0:1789892523.578162:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].169, 224 off39072 20000000:01000000:1.0:1789892523.578169:0:213611:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892523.578178:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].170, 136 off39208 00000040:00080000:1.0:1789892523.578188:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].171, 224 off39432 20000000:01000000:1.0:1789892523.578195:0:213611:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892523.578429:0:213614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 157 marker 147 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892523.578449:0:213614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 147 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892523.578465:0:213614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 169 count 166 00000040:00080000:1.0:1789892523.578549:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].169, 224 off39072 20000000:01000000:1.0:1789892523.578560:0:213611:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892523.578569:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].170, 136 off39208 00000040:00080000:1.0:1789892523.578579:0:213611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].171, 224 off39432 10000000:01000000:1.0:1789892523.578587:0:213611:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892523.578602:0:213611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578617:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578623:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578641:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578645:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578656:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578660:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578664:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578669:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578673:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578679:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578684:0:213611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578689:0:213611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578721:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578731:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 9 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.578751:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915831936:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892523.578832:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578839:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 9 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.578846:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832064:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892523.578866:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578883:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.578891:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832192:0@lo:104: 00000100:00100000:1.0:1789892523.578921:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892523.578946:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.578952:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 23 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.578961:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832320:0@lo:104: 00000100:00100000:2.0:1789892523.578967:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832192 00000100:00100000:2.0:1789892523.578975:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832192 00000100:00100000:1.0:1789892523.578979:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892523.579003:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579018:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579026:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832448:0@lo:104: 00000100:00100000:2.0:1789892523.579028:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832320 00000100:00100000:2.0:1789892523.579033:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832320 00000100:00100000:1.0:1789892523.579051:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892523.579067:0:189422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789892523.579079:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832448 00000100:00100000:0.0:1789892523.579079:0:193632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00010000:00010000:1.0:1789892523.579081:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.579088:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832448 00000100:00100000:2.0:1789892523.579101:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00010000:00010000:1.0:1789892523.579106:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 23 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579112:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789892523.579119:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832192:12345-0@lo:104: 00000100:00100000:1.0:1789892523.579127:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832576:0@lo:104: 00000100:00100000:0.0:1789892523.579128:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832320:12345-0@lo:104: 00000100:00100000:3.0:1789892523.579135:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00010000:00010000:2.0:1789892523.579135:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.579145:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.579149:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90698779b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832448:12345-0@lo:104: 00000100:00100000:1.0:1789892523.579169:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892523.579173:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579202:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579210:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.579217:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892523.579218:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832704:0@lo:104: 00010000:00010000:0.0:1789892523.579225:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892523.579231:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832192:12345-0@lo:104: Request processed in 115us (304us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892523.579234:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892523.579235:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832320:12345-0@lo:104: Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892523.579249:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90698779b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832448:12345-0@lo:104: Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892523.579250:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892523.579256:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789892523.579264:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789892523.579273:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:1.0:1789892523.579273:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892523.579283:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832576 00010000:00010000:1.0:1789892523.579284:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 23 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579288:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832704 00000100:00100000:2.0:1789892523.579289:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832576 00000100:00100000:0.0:1789892523.579297:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832704 00000100:00100000:1.0:1789892523.579298:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832832:0@lo:104: 00000100:00100000:3.0:1789892523.579316:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789892523.579329:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789892523.579335:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892523.579344:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832832 00000100:00100000:2.0:1789892523.579346:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213611:x1876834915832704:12345-0@lo:104: 00000100:00100000:0.0:1789892523.579350:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832832 00010000:00010000:2.0:1789892523.579358:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579360:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579377:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00010000:00010000:1.0:1789892523.579378:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579386:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832832:12345-0@lo:104: 00010000:00010000:0.0:1789892523.579396:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579397:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832960:0@lo:104: 00000100:00100000:3.0:1789892523.579398:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832576:12345-0@lo:104: 00010000:00010000:3.0:1789892523.579415:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.579420:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789892523.579430:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:213611:x1876834915832704:12345-0@lo:104: Request processed in 89us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892523.579440:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789892523.579455:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892523.579465:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:3.0:1789892523.579467:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789892523.579472:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915832960 00000100:00100000:0.0:1789892523.579474:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213611:x1876834915832832:12345-0@lo:104: Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892523.579476:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213611:x1876834915832576:12345-0@lo:104: Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892523.579480:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915832960 00000100:00100000:3.0:1789892523.579519:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:1.0:1789892523.579527:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579539:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:3.0:1789892523.579542:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789892523.579544:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 23 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.579548:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.579563:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892523.579566:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915833088:0@lo:104: 00000100:00100000:0.0:1789892523.579569:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 10000000:00010000:3.0:1789892523.579570:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.579581:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579588:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213611:x1876834915832960:12345-0@lo:104: 00010000:00010000:2.0:1789892523.579593:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 10000000:00010000:3.0:1789892523.579594:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579601:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892523.579603:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.579604:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892523.579642:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892523.579644:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892523.579651:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579655:0:213611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.579668:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:2.0:1789892523.579669:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579674:0:213611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579678:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213611:x1876834915832960:12345-0@lo:104: Request processed in 95us (225us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892523.579688:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579694:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 10000000:00010000:2.0:1789892523.579695:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579710:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833088 00000100:00100000:1.0:1789892523.579712:0:213611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915833216:0@lo:104: 00010000:00010000:3.0:1789892523.579715:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892523.579716:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833088 10000000:01000000:2.0:1789892523.579722:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892523.579747:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00010000:00010000:3.0:1789892523.579748:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.579754:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579761:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213611:x1876834915833088:12345-0@lo:104: 00010000:00010000:3.0:1789892523.579764:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd00213041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213048 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.579775:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892523.579779:0:213611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892523.579780:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.579793:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579801:0:213611:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca480 going to sleep for 11 seconds 00010000:00010000:2.0:1789892523.579804:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021303a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579827:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832192:0@lo:104: 00010000:00010000:0.0:1789892523.579830:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1789892523.579831:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:1.0:1789892523.579838:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832320:0@lo:104: 00010000:00010000:2.0:1789892523.579839:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579845:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213611:x1876834915833088:12345-0@lo:104: Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892523.579851:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832448:0@lo:104: 00010000:00010000:2.0:1789892523.579859:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffe00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892523.579863:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 10000000:00010000:2.0:1789892523.579866:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579868:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832576:0@lo:104: 00000100:00100000:0.0:1789892523.579880:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833216 00000100:00100000:1.0:1789892523.579884:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832704:0@lo:104: 00000100:00100000:0.0:1789892523.579891:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833216 00010000:00010000:3.0:1789892523.579895:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789892523.579896:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.579901:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832832:0@lo:104: 00010000:00010000:3.0:1789892523.579903:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579910:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789892523.579915:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832960:0@lo:104: 10000000:00010000:2.0:1789892523.579919:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.579925:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213611:x1876834915833216:12345-0@lo:104: 00010000:00010000:3.0:1789892523.579930:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800000 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892523.579931:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915833088:0@lo:104: 10000000:00010000:3.0:1789892523.579939:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.579940:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892523.579943:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892523.579962:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579963:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892523.579971:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.579980:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892523.579986:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.579992:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892523.579998:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580007:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789892523.580008:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892523.580013:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.580014:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:00010000:1.0:1789892523.580025:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580026:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213611:x1876834915833216:12345-0@lo:104: Request processed in 104us (253us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892523.580033:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892523.580039:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892523.580048:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00010000:2.0:1789892523.580053:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213010 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580063:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580069:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892523.580070:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789892523.580073:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789892523.580076:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580079:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580089:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915833856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892523.580102:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00212ffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213002 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580104:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580119:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801a00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892523.580125:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580136:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892523.580152:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580159:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:2.0:1789892523.580162:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580165:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580170:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915833600:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789892523.580180:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892523.580190:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892523.580195:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580203:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580207:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580212:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892523.580227:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892523.580228:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789892523.580229:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580239:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892523.580242:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892523.580243:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580244:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833856 00000100:00100000:0.0:1789892523.580250:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833856 00010000:00010000:2.0:1789892523.580258:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021301e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580259:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021302c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580273:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.580274:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 24 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580281:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892523.580288:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580292:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892523.580301:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892523.580302:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580303:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800a00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892523.580306:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833600 10000000:00010000:3.0:1789892523.580309:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580311:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833600 00010000:00010000:1.0:1789892523.580322:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.580325:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 25 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580327:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892523.580329:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892523.580336:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580353:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00212fed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212ff4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892523.580354:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580362:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1789892523.580374:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915833856:12345-0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789892523.580377:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892523.580386:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892523.580391:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892523.580392:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892523.580393:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580396:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892523.580401:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 25 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580402:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892523.580410:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580426:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892523.580439:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915833216:0@lo:104: 00010000:00010000:0.0:1789892523.580441:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 25 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892523.580442:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892523.580444:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580462:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd00212fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fe6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580470:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580531:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892523.580531:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00010000:00010000:0.0:1789892523.580531:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd00213002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212ffb expref: 25 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.580536:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892523.580539:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892523.580543:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892523.580544:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.580549:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915833600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892523.580552:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892523.580555:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892523.580558:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892523.580565:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00212fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00212fd8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580569:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892523.580571:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915833344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892523.580581:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580594:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.580595:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892523.580600:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892523.580600:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915833856:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892523.580604:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892523.580617:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837000/0x5c4f93dd00213010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213009 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580617:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789892523.580622:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892523.580650:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892523.580665:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833344 00000100:00100000:2.0:1789892523.580667:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915833472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892523.580670:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833344 00000100:00100000:3.0:1789892523.580705:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915833984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892523.580705:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.580714:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3622:x1876834915833600:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892523.580727:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1789892523.580734:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892523.580741:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789892523.580750:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3619:x1876834915833344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892523.580756:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833472 00010000:00010000:0.0:1789892523.580759:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892523.580763:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833472 00010000:00010000:0.0:1789892523.580765:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 22 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892523.580776:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915833728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892523.580777:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.580788:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 23 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.580798:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fa00/0x5c4f93dd00213048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213041 expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.580808:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892523.580815:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00010000:00010000:0.0:1789892523.580816:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892523.580832:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892523.580832:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915833472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892523.580844:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:1.0:1789892523.580864:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892523.580872:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 22 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580883:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3619:x1876834915833344:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (267us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892523.580893:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 22 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.580894:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915834112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892523.580903:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789892523.580928:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839232 00000100:00100000:2.0:1789892523.580930:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833728 00000100:00100000:3.0:1789892523.580932:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892523.580932:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff000/0x5c4f93dd0021303a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213033 expref: 21 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580934:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839232 00000100:00100000:2.0:1789892523.580938:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833728 00000100:00100000:3.0:1789892523.580960:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789892523.580961:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892523.580962:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 10 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.580968:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915834240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892523.580976:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 21 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.580983:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839360 00000100:00100000:0.0:1789892523.580987:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839360 00010000:00010000:0.0:1789892523.581001:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 11 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.581006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892523.581015:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3620:x1876834915833472:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892523.581016:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834112 00000100:00100000:2.0:1789892523.581023:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834112 00000100:00100000:0.0:1789892523.581027:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834240 00000100:00100000:1.0:1789892523.581028:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789892523.581032:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834240 00000100:00100000:3.0:1789892523.581037:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892523.581046:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 22 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.581050:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 22 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.581052:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915834368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892523.581054:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915833984 00000100:00100000:1.0:1789892523.581062:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915833984 00000100:00100000:0.0:1789892523.581087:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 422 00010000:00010000:1.0:1789892523.581088:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 23 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892523.581098:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1789892523.581099:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925839232:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789892523.581102:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892523.581115:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892523.581116:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3620:x1876834915833728:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892523.581121:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834368 00010000:00010000:0.0:1789892523.581122:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 11 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.581128:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834368 00010000:00010000:2.0:1789892523.581132:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892523.581135:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 11 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.581136:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915833344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892523.581141:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.581148:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.581160:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892523.581173:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.581189:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 424 00010000:00010000:2.0:1789892523.581194:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837a00/0x5c4f93dd0021302c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213025 expref: 24 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.581196:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925839232:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892523.581206:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915833472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892523.581212:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925839360:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789892523.581214:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 422 00010000:00010000:2.0:1789892523.581225:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892523.581228:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892523.581237:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 10 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.581239:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789892523.581249:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915834112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892523.581266:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 10 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.581266:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892523.581276:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892523.581282:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3620:x1876834915833728:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (454us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892523.581283:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892523.581296:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 23 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892523.581297:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789892523.581314:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00010000:00010000:0.0:1789892523.581319:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd00212ff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212fed expref: 22 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.581325:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925839360:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 121us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892523.581327:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915834240:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892523.581330:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00010000:00010000:3.0:1789892523.581343:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892523.581348:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892523.581350:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3619:x1876834915833984:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892523.581353:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 424 00010000:00010000:2.0:1789892523.581366:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892523.581375:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 21 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892523.581384:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789892523.581388:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3621:x1876834915834112:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (459us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892523.581391:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 21 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.581395:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 21 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.581398:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789892523.581401:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3619:x1876834915834368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892523.581420:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892523.581426:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 20 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.581429:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 20 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581446:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd0021301e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213017 expref: 20 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.581448:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd00212fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212fdf expref: 20 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.581458:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 20 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892523.581476:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892523.581478:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915834112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892523.581486:0:192465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.581487:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837600/0x5c4f93dd00212fd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00212fd1 expref: 18 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581509:0:192465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.581560:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915834240:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892523.581566:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00010000:00010000:0.0:1789892523.581594:0:213611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd00213056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a58f expref: 9 pid: 189432 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892523.581605:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915831936:192.168.204.33@tcp:104: 00000100:00100000:3.0:1789892523.581610:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915833856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892523.581621:0:213611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ee00/0x5c4f93dd0021304f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a588 expref: 8 pid: 189434 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892523.581645:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915833600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892523.581646:0:213611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213611:1876834915832064:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892523.581738:0:213611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892523.581761:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892523.581781:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915834240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892523.581814:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915833728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892523.581820:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3619:x1876834915834368:12345-0@lo:103:ldlm_bl.0 Request processed in 423us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892523.581832:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789892523.581834:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915834368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892523.581934:0:192465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581945:0:192465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581952:0:192465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581959:0:192465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581966:0:192465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801c00 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:2.0:1789892523.581970:0:192465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581978:0:192465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.581997:0:192465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.582014:0:213611:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892523.582022:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892523.582022:0:213611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892523.582030:0:213611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801c00/0x5c4f93dd0021305d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892523.582070:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3619:x1876834915833984:12345-0@lo:103:ldlm_bl.0 Request processed in 726us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892523.582080:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789892523.582097:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915833984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892523.810743:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892523.919747:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892523.919786:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892523.919835:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839488 00000100:00100000:2.0:1789892523.919847:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839488 00000100:00100000:0.0:1789892523.919864:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839616 00000100:00100000:0.0:1789892523.919871:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839616 00000100:00080000:1.0:1789892523.919935:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789892523.919942:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892523.919944:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 433 00000100:00100000:2.0:1789892523.919956:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 434 00000100:00100000:0.0:1789892523.919963:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925839616:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892523.919970:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2401:x1876834925839488:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892523.920045:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2401:x1876834925839488:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892523.920046:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925839616:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892523.920057:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 434 00000100:00100000:0.0:1789892523.920064:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 433 00010000:00010000:3.0:1789892524.834707:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892525.071479:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.071536:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839744 00000100:00100000:0.0:1789892525.071546:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839744 00000100:00100000:0.0:1789892525.071614:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1798 00000100:00100000:0.0:1789892525.071626:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925839744:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.071645:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.071666:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a596 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.071691:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.071700:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.071722:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892525.071770:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925839744:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 148us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.071776:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1798 00000100:00100000:3.0:1789892525.072644:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.072685:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925839872 00000100:00100000:0.0:1789892525.072689:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925839872 00000100:00100000:0.0:1789892525.072716:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1799 00000100:00100000:0.0:1789892525.072723:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925839872:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.072831:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925839872:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 109us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.072836:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1799 00000100:00100000:3.0:1789892525.073388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.073424:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840000 00000100:00100000:0.0:1789892525.073428:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840000 00000100:00100000:0.0:1789892525.073453:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1800 00000100:00100000:0.0:1789892525.073460:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925840000:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.073570:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925840000:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 110us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.073575:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1800 00000100:00100000:3.0:1789892525.074566:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.074618:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840128 00000100:00100000:0.0:1789892525.074621:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840128 00000100:00100000:0.0:1789892525.074645:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1801 00000100:00100000:0.0:1789892525.074653:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212805:x1876834925840128:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892525.074727:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212805:x1876834925840128:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.074737:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1801 00000100:00100000:3.0:1789892525.075398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.075439:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840256 00000100:00100000:0.0:1789892525.075443:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840256 00000100:00100000:0.0:1789892525.075468:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1802 00000100:00100000:0.0:1789892525.075476:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212805:x1876834925840256:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892525.075557:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212805:x1876834925840256:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.075562:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1802 00000100:00100000:3.0:1789892525.076399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.076435:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840384 00000100:00100000:0.0:1789892525.076440:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840384 00000100:00100000:0.0:1789892525.076467:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1803 00000100:00100000:0.0:1789892525.076475:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925840384:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.076483:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.076509:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a59d expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.076528:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.076535:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.076541:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892525.076565:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925840384:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.076570:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1803 00000100:00100000:3.0:1789892525.077186:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892525.077232:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840512 00000100:00100000:0.0:1789892525.077237:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840512 00000100:00100000:0.0:1789892525.077266:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1804 00000100:00100000:0.0:1789892525.077271:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925840512:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.077321:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925840512:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 49us (135us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892525.077327:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1804 10000000:01000000:2.0:1789892525.090605:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892525.090613:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 147 10000000:01000000:2.0:1789892525.090619:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892525.090658:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.090668:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.090677:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892525.090698:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915834496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.090747:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.090786:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.090802:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834496 00000100:00100000:0.0:1789892525.090811:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834496 00000100:00100000:0.0:1789892525.090854:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:0.0:1789892525.090861:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915834496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.090872:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.090883:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213072 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.090902:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.090910:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.090916:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836600, rc 0) 00000100:00100000:0.0:1789892525.090954:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915834496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.090961:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1789892525.090990:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915834496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892525.091022:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.091029:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892525.091078:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915834624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.091099:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.091112:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.091136:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834624 00000100:00100000:0.0:1789892525.091141:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834624 00000100:00100000:0.0:1789892525.091163:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:0.0:1789892525.091175:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915834624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.091263:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915834624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.091268:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1789892525.091292:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915834624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.091316:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915834752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.091348:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.091362:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.091383:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834752 00000100:00100000:0.0:1789892525.091387:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834752 00000100:00100000:0.0:1789892525.091406:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:0.0:1789892525.091410:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915834752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.091478:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915834752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.091484:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:2.0:1789892525.091521:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915834752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.091839:0:213615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213615:1876834915834880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.091866:0:213615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.091884:0:213615:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.091902:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915834880 00000100:00100000:0.0:1789892525.091907:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915834880 00000100:00100000:0.0:1789892525.091929:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:0.0:1789892525.091933:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213615:x1876834915834880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.091999:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213615:x1876834915834880:12345-0@lo:502:llog_process_th.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.092005:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:2.0:1789892525.092026:0:213615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213615:1876834915834880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.092064:0:213615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213615:1876834915835008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.092088:0:213615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.092101:0:213615:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.092122:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835008 00000100:00100000:0.0:1789892525.092126:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835008 00000100:00100000:0.0:1789892525.092147:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1789892525.092151:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213615:x1876834915835008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.092207:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213615:x1876834915835008:12345-0@lo:502:llog_process_th.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.092214:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1789892525.092226:0:213615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213615:1876834915835008:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892525.092248:0:213615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:1.0:1789892525.092319:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:1.0:1789892525.092349:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892525.092356:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.092365:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892525.092381:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892525.092383:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789892525.092385:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892525.092399:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.092404:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.092410:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.092420:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.092447:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.092464:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.092484:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835136 00000100:00100000:0.0:1789892525.092512:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835136 00000100:00100000:0.0:1789892525.092541:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:0.0:1789892525.092546:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915835136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.092552:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.092558:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213080 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.092568:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.092574:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.092579:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837e00, rc 0) 00000100:00100000:0.0:1789892525.092623:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915835136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.092627:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:1.0:1789892525.092654:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892525.092663:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.092669:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.092703:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.092722:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.092741:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.092759:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835264 00000100:00100000:0.0:1789892525.092763:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835264 00000100:00100000:0.0:1789892525.092782:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:0.0:1789892525.092786:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915835264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.092844:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915835264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.092850:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:1.0:1789892525.092868:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.092897:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.092923:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.092937:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.092945:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835392 00000100:00100000:0.0:1789892525.092949:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835392 00000100:00100000:0.0:1789892525.092968:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1789892525.092973:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915835392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.093042:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915835392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.093051:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1789892525.093056:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892525.093719:0:213616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:2.0:1789892525.093769:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:2.0:1789892525.093787:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892525.093792:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.093800:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892525.093806:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892525.093807:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 147 10000000:01000000:2.0:1789892525.093809:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892525.093821:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.093826:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.093832:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892525.093841:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.093864:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.093885:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.093909:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835520 00000100:00100000:0.0:1789892525.093915:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835520 00000100:00100000:0.0:1789892525.093941:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1789892525.093946:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915835520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.093953:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.093961:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021308e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.093974:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.093982:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.093987:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837c00, rc 0) 00000100:00100000:0.0:1789892525.094019:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915835520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.094026:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1789892525.094044:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892525.094055:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.094062:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892525.094102:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.094121:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.094135:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.094157:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835648 00000100:00100000:0.0:1789892525.094162:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835648 00000100:00100000:0.0:1789892525.094183:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:0.0:1789892525.094187:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915835648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.094244:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915835648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.094258:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:2.0:1789892525.094269:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.094292:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.094320:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.094333:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.094343:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835776 00000100:00100000:0.0:1789892525.094347:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835776 00000100:00100000:0.0:1789892525.094365:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1789892525.094370:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915835776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.094426:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915835776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.094432:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:2.0:1789892525.094443:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915835776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.094645:0:213617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213617:1876834915835904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.094672:0:213617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.094696:0:213617:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.094721:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915835904 00000100:00100000:0.0:1789892525.094726:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915835904 00000100:00100000:0.0:1789892525.094756:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1789892525.094763:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213617:x1876834915835904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.094842:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213617:x1876834915835904:12345-0@lo:502:llog_process_th.0 Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.094850:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1789892525.094873:0:213617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213617:1876834915835904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.094915:0:213617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213617:1876834915836032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.094951:0:213617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.094970:0:213617:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.094986:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836032 00000100:00100000:0.0:1789892525.094991:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836032 00000100:00100000:0.0:1789892525.095024:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1789892525.095032:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213617:x1876834915836032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.095102:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213617:x1876834915836032:12345-0@lo:502:llog_process_th.0 Request processed in 70us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.095111:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:2.0:1789892525.095121:0:213617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213617:1876834915836032:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892525.095150:0:213617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:1.0:1789892525.095215:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:1.0:1789892525.095242:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892525.095249:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.095259:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892525.095267:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892525.095269:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789892525.095271:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892525.095288:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.095295:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.095301:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.095310:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.095332:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.095348:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.095378:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836160 00000100:00100000:0.0:1789892525.095383:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836160 00000100:00100000:0.0:1789892525.095412:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:0.0:1789892525.095419:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915836160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.095435:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.095444:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021309c expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.095459:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.095468:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.095476:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837a00, rc 0) 00000100:00100000:0.0:1789892525.095536:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915836160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.095544:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1789892525.095548:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892525.095562:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.095570:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.095614:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.095636:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.095655:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.095670:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836288 00000100:00100000:0.0:1789892525.095675:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836288 00000100:00100000:0.0:1789892525.095705:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:0.0:1789892525.095713:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915836288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.095789:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915836288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.095797:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:1.0:1789892525.095815:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.095836:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.095863:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.095876:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.095893:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836416 00000100:00100000:0.0:1789892525.095899:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836416 00000100:00100000:0.0:1789892525.095928:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:0.0:1789892525.095936:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915836416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.096014:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915836416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892525.096023:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.096039:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000040:00080000:0.0:1789892525.096579:0:213618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:1.0:1789892525.096662:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892525.096680:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892525.096686:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.096695:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892525.096702:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892525.096704:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 147 10000000:01000000:1.0:1789892525.096705:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892525.096716:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.096727:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.096733:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.096741:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.096761:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.096778:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.096788:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836544 00000100:00100000:0.0:1789892525.096794:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836544 00000100:00100000:0.0:1789892525.096825:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1789892525.096833:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915836544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.096840:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.096850:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002130aa expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.096865:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.096874:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.096881:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892525.096917:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915836544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.096924:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:1.0:1789892525.096928:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892525.096941:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.096948:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.096975:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.096992:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.097004:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.097013:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836672 00000100:00100000:0.0:1789892525.097017:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836672 00000100:00100000:0.0:1789892525.097037:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1789892525.097041:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915836672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.097097:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915836672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.097102:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:1.0:1789892525.097109:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.097133:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.097160:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.097173:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.097180:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836800 00000100:00100000:0.0:1789892525.097184:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836800 00000100:00100000:0.0:1789892525.097204:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1789892525.097208:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915836800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.097263:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915836800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.097268:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:1.0:1789892525.097289:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915836800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.097449:0:213619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213619:1876834915836928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892525.097478:0:213619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892525.097517:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915836928 00000100:00100000:0.0:1789892525.097521:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915836928 00000100:00100000:1.0:1789892525.097525:0:213619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.097553:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1789892525.097559:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213619:x1876834915836928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.097633:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213619:x1876834915836928:12345-0@lo:502:llog_process_th.0 Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.097640:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:1.0:1789892525.097658:0:213619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213619:1876834915836928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892525.097689:0:213619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213619:1876834915837056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892525.097713:0:213619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.097726:0:213619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.097737:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837056 00000100:00100000:0.0:1789892525.097742:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837056 00000100:00100000:0.0:1789892525.097767:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1789892525.097773:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213619:x1876834915837056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.097830:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213619:x1876834915837056:12345-0@lo:502:llog_process_th.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.097836:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:1.0:1789892525.097846:0:213619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213619:1876834915837056:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892525.097865:0:213619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:2.0:1789892525.097910:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:2.0:1789892525.097929:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892525.097934:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.097951:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892525.097957:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892525.097958:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 169 10000000:01000000:2.0:1789892525.097960:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892525.097972:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.097978:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.097984:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892525.097993:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.098017:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.098039:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.098051:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837184 00000100:00100000:0.0:1789892525.098056:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837184 00000100:00100000:0.0:1789892525.098084:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1789892525.098093:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915837184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.098099:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.098110:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002130b8 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.098121:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.098127:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.098132:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837000, rc 0) 00000100:00100000:0.0:1789892525.098159:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915837184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.098164:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:2.0:1789892525.098169:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892525.098181:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.098188:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892525.098217:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.098236:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.098258:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.098259:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837312 00000100:00100000:0.0:1789892525.098263:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837312 00000100:00100000:0.0:1789892525.098284:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1789892525.098289:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915837312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.098343:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915837312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.098349:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1789892525.098352:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.098378:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.098408:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.098421:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.098427:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837440 00000100:00100000:0.0:1789892525.098431:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837440 00000100:00100000:0.0:1789892525.098452:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1789892525.098457:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915837440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.098540:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915837440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.098546:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1789892525.098553:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.098726:0:213620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213620:1876834915837568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.098752:0:213620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892525.098776:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837568 00000100:00100000:2.0:1789892525.098778:0:213620:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.098786:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837568 00000100:00100000:0.0:1789892525.098810:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:0.0:1789892525.098816:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213620:x1876834915837568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.098882:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213620:x1876834915837568:12345-0@lo:502:llog_process_th.0 Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.098888:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1789892525.098900:0:213620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213620:1876834915837568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892525.098923:0:213620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892525.098931:0:213620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892525.098933:0:213620:0:(obd_config.c:1561:class_process_config()) marker 159 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892525.098937:0:213620:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892525.098953:0:213620:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000100:00100000:2.0:1789892525.098966:0:213620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213620:1876834915837696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.098992:0:213620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.099006:0:213620:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.099011:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837696 00000100:00100000:0.0:1789892525.099015:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837696 00000100:00100000:0.0:1789892525.099043:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:0.0:1789892525.099053:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213620:x1876834915837696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.099132:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213620:x1876834915837696:12345-0@lo:502:llog_process_th.0 Request processed in 81us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892525.099136:0:213620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213620:1876834915837696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.099148:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000020:01000000:2.0:1789892525.099158:0:213620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892525.099163:0:213620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892525.099164:0:213620:0:(obd_config.c:1561:class_process_config()) marker 159 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892525.099168:0:213620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 172 count 169 00000020:01000000:1.0:1789892525.099231:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 169-171 (rc=0) 10000000:01000000:1.0:1789892525.099257:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892525.099262:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.099269:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892525.099274:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892525.099275:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 147 10000000:01000000:1.0:1789892525.099277:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892525.099288:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.099293:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.099298:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.099314:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.099333:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.099345:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.099361:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837824 00000100:00100000:0.0:1789892525.099367:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837824 00000100:00100000:0.0:1789892525.099397:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1789892525.099406:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915837824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892525.099414:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892525.099423:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002130c6 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.099439:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.099448:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892525.099455:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892525.099529:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915837824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.099537:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:1.0:1789892525.099540:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892525.099553:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.099560:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.099593:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.099632:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.099660:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.099660:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915837952 00000100:00100000:0.0:1789892525.099667:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915837952 00000100:00100000:0.0:1789892525.099697:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1789892525.099706:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915837952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.099777:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915837952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892525.099786:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:1.0:1789892525.099789:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915837952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.099815:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.099840:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.099852:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892525.099864:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838080 00000100:00100000:0.0:1789892525.099870:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838080 00000100:00100000:0.0:1789892525.099900:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1789892525.099910:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915838080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.099991:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915838080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892525.100001:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892525.100002:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1789892525.100165:0:213621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213621:1876834915838208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.100206:0:213621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892525.100228:0:213621:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a408900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892525.100230:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838208 00000100:00100000:2.0:1789892525.100235:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838208 00000100:00100000:2.0:1789892525.100261:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:2.0:1789892525.100271:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213621:x1876834915838208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.100339:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213621:x1876834915838208:12345-0@lo:502:llog_process_th.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892525.100346:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:0.0:1789892525.100368:0:213621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213621:1876834915838208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.100413:0:213621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213621:1876834915838336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.100453:0:213621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892525.100475:0:213621:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a408900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892525.100519:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838336 00000100:00100000:3.0:1789892525.100524:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838336 00000100:00100000:3.0:1789892525.100560:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:3.0:1789892525.100571:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213621:x1876834915838336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892525.100661:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213621:x1876834915838336:12345-0@lo:502:llog_process_th.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892525.100669:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1789892525.100682:0:213621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213621:1876834915838336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892525.100718:0:213621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:1.0:1789892525.100780:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:1.0:1789892525.100798:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892525.100803:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.100809:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892525.100820:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892525.100821:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 169 10000000:01000000:1.0:1789892525.100823:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892525.100833:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.100838:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.100843:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.100852:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.100870:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.100888:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892525.100910:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838464 00000100:00100000:2.0:1789892525.100916:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838464 00000100:00100000:2.0:1789892525.100947:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1789892525.100957:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915838464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892525.100965:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892525.100975:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002130d4 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.100993:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.101003:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892525.101011:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffec00, rc 0) 00000100:00100000:2.0:1789892525.101050:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915838464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892525.101058:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:1.0:1789892525.101071:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892525.101083:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.101089:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.101115:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.101133:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.101146:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892525.101167:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838592 00000100:00100000:3.0:1789892525.101172:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838592 00000100:00100000:3.0:1789892525.101203:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:3.0:1789892525.101210:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915838592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892525.101279:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915838592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892525.101285:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:1.0:1789892525.101313:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.101344:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.101374:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.101391:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892525.101415:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838720 00000100:00100000:2.0:1789892525.101420:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838720 00000100:00100000:2.0:1789892525.101453:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1789892525.101462:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915838720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.101571:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915838720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892525.101578:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915838720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892525.101593:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1789892525.101766:0:213622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213622:1876834915838848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892525.101801:0:213622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.101827:0:213622:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892525.101862:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838848 00000100:00100000:3.0:1789892525.101869:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838848 00000100:00100000:3.0:1789892525.101902:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1789892525.101911:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213622:x1876834915838848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892525.102018:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213622:x1876834915838848:12345-0@lo:502:llog_process_th.0 Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892525.102027:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1789892525.102030:0:213622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213622:1876834915838848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892525.102057:0:213622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892525.102064:0:213622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892525.102066:0:213622:0:(obd_config.c:1561:class_process_config()) marker 158 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892525.102072:0:213622:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892525.102081:0:213622:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000020:01000004:2.0:1789892525.102419:0:213623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789892525.102424:0:213623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:0.0:1789892525.102430:0:213622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213622:1876834915838976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892525.102475:0:213622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892525.102546:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915838976 00000100:00100000:3.0:1789892525.102553:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915838976 00000100:00100000:0.0:1789892525.102564:0:213622:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a408900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892525.102589:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1789892525.102615:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213622:x1876834915838976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892525.102705:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213622:x1876834915838976:12345-0@lo:502:llog_process_th.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892525.102714:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:0.0:1789892525.102734:0:213622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213622:1876834915838976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892525.102760:0:213622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892525.102766:0:213622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892525.102768:0:213622:0:(obd_config.c:1561:class_process_config()) marker 158 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789892525.102772:0:213622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 172 count 169 00000020:01000000:1.0:1789892525.102829:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 169-171 (rc=0) 10000000:01000000:1.0:1789892525.102847:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892525.102851:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.102857:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892525.102863:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892525.102864:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:1.0:1789892525.102865:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892525.102876:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.102881:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.102886:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.102894:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915839104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.102914:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.102927:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892525.102960:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839104 00000100:00100000:3.0:1789892525.102966:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839104 00000100:00100000:3.0:1789892525.102996:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1789892525.103003:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915839104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892525.103012:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892525.103022:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002130e2 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892525.103037:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892525.103047:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892525.103054:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ea00, rc 0) 00000100:00100000:3.0:1789892525.103094:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915839104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892525.103101:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:1.0:1789892525.103121:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915839104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892525.103139:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.103147:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892525.103185:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915839232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892525.103206:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892525.103223:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892525.103250:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839232 00000100:00100000:3.0:1789892525.103256:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839232 00000100:00100000:3.0:1789892525.103283:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1789892525.103292:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915839232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892525.103350:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915839232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892525.103367:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915839232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892525.103372:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 10000000:01000000:1.0:1789892525.103392:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892525.103398:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892525.103404:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892525.858607:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892525.858753:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915839360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892525.858824:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892525.858876:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839360 00000100:00100000:2.0:1789892525.858886:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839360 00000100:00100000:2.0:1789892525.858947:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789892525.858961:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915839360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892525.858999:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892525.859064:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915839360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892525.859075:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789892525.859092:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915839360:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1789892526.175192:0:213721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff089e0170 20000000:00000080:1.0:1789892526.175209:0:213721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90698779a400 uarg=0000000000000000 00000040:00100000:1.0:1789892526.175757:0:213721:0:(llog.c:1072:llog_reverse_process()) index 149 : idx 137 20000000:01000000:1.0:1789892526.175762:0:213721:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 148 cmd:0xce022 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:1.0:1789892526.175774:0:213721:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892526.176083:0:213722:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 128 marker 139 1->4: lustre-clilov new lustre.qpool1 20000000:01000000:3.0:1789892526.176122:0:213722:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 130 marker 139 2->4: lustre-clilov new lustre.qpool1 00000040:00080000:3.0:1789892526.176135:0:213722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000040:00080000:1.0:1789892526.176250:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].150, 224 off35496 20000000:01000000:1.0:1789892526.176264:0:213721:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789892526.176274:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].151, 104 off35600 00000040:00080000:1.0:1789892526.176284:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].152, 224 off35824 20000000:01000000:1.0:1789892526.176293:0:213721:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892526.176559:0:213723:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 151 marker 140 1->4: lustre-MDT0000-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892526.176597:0:213723:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 153 marker 140 2->4: lustre-MDT0000-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892526.176616:0:213723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 172 count 169 00000040:00080000:1.0:1789892526.176701:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].172, 224 off39656 20000000:01000000:1.0:1789892526.176716:0:213721:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789892526.176727:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].173, 112 off39768 00000040:00080000:1.0:1789892526.176736:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].174, 224 off39992 20000000:01000000:1.0:1789892526.176744:0:213721:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892526.177065:0:213724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 151 marker 141 1->4: lustre-MDT0001-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892526.177086:0:213724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 153 marker 141 2->4: lustre-MDT0001-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892526.177102:0:213724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 172 count 169 00000040:00080000:1.0:1789892526.177190:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].172, 224 off39656 20000000:01000000:1.0:1789892526.177203:0:213721:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789892526.177231:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].173, 112 off39768 00000040:00080000:1.0:1789892526.177247:0:213721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].174, 224 off39992 10000000:01000000:1.0:1789892526.177256:0:213721:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892526.177271:0:213721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177287:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177294:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177299:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177304:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177308:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177312:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177316:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177326:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177331:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177336:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177340:0:213721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177345:0:213721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177377:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177388:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 23 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.177399:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915839488:0@lo:104: 00000100:00100000:1.0:1789892526.177458:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.177538:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839488 00000100:00100000:0.0:1789892526.177555:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839488 00000100:00100000:0.0:1789892526.177671:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789892526.177692:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906986b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213721:x1876834915839488:12345-0@lo:104: 00010000:00010000:0.0:1789892526.177714:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.177826:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892526.177838:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906986b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213721:x1876834915839488:12345-0@lo:104: Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.177850:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:1.0:1789892526.177853:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.177857:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892526.177865:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 23 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.177868:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.177891:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801e00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892526.177897:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915839616:0@lo:104: 10000000:00010000:3.0:1789892526.177899:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.177912:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892526.177923:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.177932:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892526.177946:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892526.177965:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.177975:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 23 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.177987:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915839744:0@lo:104: 00000100:00100000:2.0:1789892526.177990:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839616 00010000:00010000:3.0:1789892526.177994:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.178000:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839616 00010000:00010000:3.0:1789892526.178007:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892526.178007:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892526.178042:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.178047:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839744 00010000:00010000:1.0:1789892526.178050:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.178054:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839744 00010000:00010000:3.0:1789892526.178066:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801e00/0x5c4f93dd002130e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130e9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.178069:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00010000:00010000:1.0:1789892526.178089:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 23 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.178099:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892526.178099:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915839616:12345-0@lo:104: 00000100:00100000:2.0:1789892526.178108:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00010000:00010000:3.0:1789892526.178110:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892526.178115:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840000:0@lo:104: 00010000:00010000:3.0:1789892526.178118:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892526.178126:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.178127:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915839744:12345-0@lo:104: 00000100:00100000:3.0:1789892526.178142:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915839872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892526.178145:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.178175:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.178230:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892526.178242:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.178250:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892526.178252:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 23 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178259:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892526.178274:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915839616:12345-0@lo:104: Request processed in 176us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.178276:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915839744:12345-0@lo:104: Request processed in 152us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.178292:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840128:0@lo:104: 00000100:00100000:2.0:1789892526.178301:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789892526.178317:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840000 00000100:00100000:0.0:1789892526.178325:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789892526.178328:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840000 00010000:00010000:2.0:1789892526.178341:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892526.178348:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892526.178349:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178358:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800c00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892526.178362:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.178364:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840128 00000100:00100000:0.0:1789892526.178373:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840128 00010000:00010000:2.0:1789892526.178374:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.178384:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00010000:00010000:1.0:1789892526.178384:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892526.178400:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892526.178407:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892526.178413:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840000:12345-0@lo:104: 00000100:00100000:0.0:1789892526.178425:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00010000:00010000:3.0:1789892526.178443:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.178444:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 23 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.178454:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840128:12345-0@lo:104: 00010000:00010000:2.0:1789892526.178455:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178537:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892526.178537:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.178549:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840256:0@lo:104: 00010000:00010000:2.0:1789892526.178564:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178587:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd002130d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130db expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.178611:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892526.178618:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892526.178630:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892526.178631:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.178632:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840000:12345-0@lo:104: Request processed in 218us (449us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892526.178642:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892526.178669:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178671:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892526.178671:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840128:12345-0@lo:104: Request processed in 218us (314us total) trans 0 rc 0/0 10000000:00010000:2.0:1789892526.178683:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.178685:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00010000:00010000:1.0:1789892526.178708:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 23 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178713:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.178720:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789892526.178725:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840256 00000100:00100000:3.0:1789892526.178746:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840256 10000000:00010000:2.0:1789892526.178754:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.178755:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840512:0@lo:104: 10000000:01000000:2.0:1789892526.178773:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892526.178775:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915839872 00000100:00100000:0.0:1789892526.178784:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915839872 00010000:00010000:2.0:1789892526.178800:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.178810:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.178823:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00010000:00010000:0.0:1789892526.178826:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 24 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.178827:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892526.178840:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 24 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.178849:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213721:x1876834915840256:12345-0@lo:104: 00010000:00010000:2.0:1789892526.178850:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.178858:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 24 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.178878:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.178882:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00010000:00010000:2.0:1789892526.178894:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801200/0x5c4f93dd002130c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130cd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.178919:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840768:0@lo:104: 00000100:00100000:0.0:1789892526.178919:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915839872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892526.178959:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892526.178960:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892526.178969:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.178973:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 24 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.178986:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892526.178991:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892526.179010:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213721:x1876834915840256:12345-0@lo:104: Request processed in 167us (386us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892526.179024:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 24 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179039:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffea00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892526.179044:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 10000000:00010000:2.0:1789892526.179047:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179062:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.179063:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179076:0:193633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:00010000:2.0:1789892526.179098:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179106:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840512 10000000:01000000:2.0:1789892526.179106:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892526.179107:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 24 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179121:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840512 00010000:00010000:2.0:1789892526.179134:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179136:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840896:0@lo:104: 00010000:00010000:2.0:1789892526.179141:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892526.179145:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892526.179149:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840768 00010000:00010000:2.0:1789892526.179153:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179157:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840768 00010000:00010000:2.0:1789892526.179166:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd002130b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130bf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179182:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892526.179186:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179193:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892526.179198:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179208:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789892526.179221:0:213721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.179223:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915839872:12345-0@lo:103:ldlm_bl.0 Request processed in 314us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.179240:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840512:12345-0@lo:104: 00010000:00010000:2.0:1789892526.179240:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.179257:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.179257:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00010000:00010000:3.0:1789892526.179273:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892526.179284:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.179298:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892526.179304:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 9 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.179316:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892526.179341:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892526.179353:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892526.179365:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840512:12345-0@lo:104: Request processed in 137us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.179366:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915841152:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892526.179366:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801800 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:2.0:1789892526.179373:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892526.179380:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179401:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00010000:00010000:2.0:1789892526.179419:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892526.179428:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179434:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179436:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840896 00000100:00100000:3.0:1789892526.179446:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840896 00010000:00010000:1.0:1789892526.179447:0:213721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892526.179460:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179474:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00010000:00010000:2.0:1789892526.179474:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd002130aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130b1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179538:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b7755c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840768:12345-0@lo:104: 10000000:01000000:0.0:1789892526.179566:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892526.179591:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892526.179592:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.179592:0:213721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 9 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179604:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.179615:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179653:0:213721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915841408:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892526.179657:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffe00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892526.179670:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.179671:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892526.179679:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.179683:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789892526.179685:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892526.179686:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179693:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b7755c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213721:x1876834915840768:12345-0@lo:104: Request processed in 200us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.179706:0:213721:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.179728:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00010000:0.0:1789892526.179730:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd0021309c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130a3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892526.179735:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892526.179736:0:213721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ea00/0x5c4f93dd002130e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002130e2 expref: 23 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179776:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.179779:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789892526.179782:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915839488:0@lo:104: 00010000:00010000:0.0:1789892526.179789:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892526.179804:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179808:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892526.179811:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213721:x1876834915840896:12345-0@lo:104: 00010000:00010000:2.0:1789892526.179821:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179822:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915839616:0@lo:104: 00010000:00010000:3.0:1789892526.179842:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179856:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915839744:0@lo:104: 00010000:00010000:2.0:1789892526.179869:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021308e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213095 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179883:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840000:0@lo:104: 00010000:00010000:0.0:1789892526.179910:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892526.179918:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.179921:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892526.179927:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840128:0@lo:104: 00010000:00010000:2.0:1789892526.179928:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892526.179939:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892526.179952:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179957:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840256:0@lo:104: 00010000:00010000:3.0:1789892526.179960:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892526.179965:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892526.179980:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892526.179986:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.179990:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840512:0@lo:104: 00000100:00100000:3.0:1789892526.179992:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213721:x1876834915840896:12345-0@lo:104: Request processed in 184us (780us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892526.180022:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892526.180029:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840768:0@lo:104: 10000000:00010000:2.0:1789892526.180034:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892526.180035:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892526.180047:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00010000:2.0:1789892526.180067:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892526.180080:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.180080:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915840896:0@lo:104: 00010000:00010000:0.0:1789892526.180081:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.180093:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892526.180111:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892526.180114:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892526.180123:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.180134:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801600/0x5c4f93dd00213080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213087 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.180137:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.180151:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892526.180159:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.180161:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892526.180166:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213079 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.180167:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892526.180172:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892526.180184:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892526.180186:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892526.180188:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892526.180203:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915840640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892526.180238:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915841024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892526.180250:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892526.180251:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892526.180277:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892526.180302:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840640 00000100:00100000:2.0:1789892526.180308:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915841664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892526.180310:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.180313:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840640 00000100:00100000:3.0:1789892526.180314:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915840384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.180346:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892526.180355:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 23 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.180357:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915841792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.180408:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915841024 00000100:00100000:0.0:1789892526.180409:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.180413:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915841024 00000100:00100000:1.0:1789892526.180413:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915841664 00000100:00100000:1.0:1789892526.180428:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915841664 00010000:00010000:2.0:1789892526.180442:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 25 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.180459:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 25 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.180460:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915841280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.180472:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915841792 00000100:00100000:2.0:1789892526.180477:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915841792 00010000:00010000:2.0:1789892526.180537:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 26 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.180557:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.180588:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915841280 00000100:00100000:0.0:1789892526.180598:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915841280 00000100:00100000:1.0:1789892526.180603:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789892526.180615:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789892526.180624:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3619:x1876834915840640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892526.180632:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 27 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.180634:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915841920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.180635:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915841024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892526.180636:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892526.180653:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 27 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.180654:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892526.180674:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 27 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.180683:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 27 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.180693:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00010000:00010000:2.0:1789892526.180713:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 27 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.180715:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3619:x1876834915841664:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892526.180732:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892526.180735:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892526.180743:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd002130cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002130c6 expref: 27 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.180748:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 27 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.180754:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837000/0x5c4f93dd002130bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002130b8 expref: 27 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.180765:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915839872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892526.180787:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892526.180810:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 25 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.180823:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892526.180836:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021308e expref: 25 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.180854:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915840640:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (601us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892526.180859:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892526.180865:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915841920 00000100:00100000:1.0:1789892526.180866:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1789892526.180874:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915841920 00000100:00100000:2.0:1789892526.180881:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915841024:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.180891:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789892526.180906:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00010000:00010000:3.0:1789892526.180907:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 24 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.180916:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3619:x1876834915841664:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.180930:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3620:x1876834915841792:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892526.180948:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:1.0:1789892526.180972:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892526.180973:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00010000:00010000:1.0:1789892526.180986:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 22 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.180994:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789892526.180999:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915841280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892526.181020:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915841920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892526.181029:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892526.181030:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 22 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.181035:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892526.181046:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 22 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.181049:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892526.181053:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 22 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.181085:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837e00/0x5c4f93dd00213087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213080 expref: 22 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.181086:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 22 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.181092:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915841536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892526.181144:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837600/0x5c4f93dd002130b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002130aa expref: 21 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.181152:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 21 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.181162:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892526.181182:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892526.181183:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892526.181196:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd00213079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213072 expref: 20 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.181221:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892526.181244:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915840384 00000100:00100000:0.0:1789892526.181253:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915840384 00000100:00100000:2.0:1789892526.181258:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915841280:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.181270:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1789892526.181280:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3620:x1876834915841792:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (871us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892526.181286:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 20 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.181296:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915841536 00000100:00100000:3.0:1789892526.181299:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915841920:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.181300:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789892526.181316:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915841536 00000100:00100000:3.0:1789892526.181325:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00010000:2.0:1789892526.181340:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 19 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.181382:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789892526.181409:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789892526.181416:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915840384:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892526.181430:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915841536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892526.181432:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892526.181446:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 18 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.181450:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892526.181464:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 18 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.181471:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915840640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892526.181471:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 18 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.181535:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915841664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892526.181559:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002130db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002130d4 expref: 18 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.181597:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892526.181624:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 17 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.181626:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915841024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.181656:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915841792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892526.181660:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837a00/0x5c4f93dd002130a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021309c expref: 17 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.181676:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3622:x1876834915840384:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.181711:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00010000:00010000:3.0:1789892526.181717:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892526.181722:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915841280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.181746:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915841920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892526.181791:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915840384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892526.181802:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915841536:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.181821:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789892526.181834:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915841536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892526.181940:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892526.181947:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915841152:192.168.204.33@tcp:104: 00000100:00100000:1.0:1789892526.181966:0:213721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213721:1876834915841408:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892526.182004:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892526.182021:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840640 00000100:00100000:3.0:1789892526.182030:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840640 00010000:00010000:1.0:1789892526.182057:0:213721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.182061:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840768 00010000:00010000:3.0:1789892526.182063:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 10 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.182075:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840768 00010000:00010000:0.0:1789892526.182106:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 11 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.182113:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 438 00000100:00100000:3.0:1789892526.182136:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc394050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925840640:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892526.182147:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892526.182153:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 11 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.182165:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 439 00010000:00010000:3.0:1789892526.182172:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 11 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.182184:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925840768:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892526.182193:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd00213064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a596 expref: 11 pid: 189432 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182200:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892526.182208:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892526.182210:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 10 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182242:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 10 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892526.182252:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc394050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925840640:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.182272:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 438 00010000:00010000:0.0:1789892526.182280:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd0021306b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a59d expref: 10 pid: 189434 timeout: 3451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182305:0:199151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182316:0:199151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182335:0:199151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182344:0:199151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182352:0:199151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182360:0:199151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182368:0:199151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:0.0:1789892526.182374:0:199151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182383:0:199151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182415:0:199151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.182423:0:213721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.182429:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892526.182432:0:213721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.182438:0:213721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800200/0x5c4f93dd002130f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.182483:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2400:x1876834925840768:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 304us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.182534:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 439 00000100:00100000:2.0:1789892526.370702:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915842176:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892526.370722:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915842048:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892526.370744:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915842304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892526.370752:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915842432:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892526.370824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.370835:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.370880:0:190971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842176 00000100:00100000:1.0:1789892526.370890:0:190971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842176 00000100:00100000:0.0:1789892526.370919:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.370940:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915842688:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892526.370941:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876834915842816:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892526.370963:0:190971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842048 00000100:00100000:0.0:1789892526.370970:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915842560:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892526.370973:0:190971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842048 00000100:00100000:3.0:1789892526.370991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.371035:0:190971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842816 00000100:00100000:1.0:1789892526.371043:0:190971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842816 00000100:00100000:0.0:1789892526.371046:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.371050:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842304 00000100:00100000:2.0:1789892526.371057:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842304 00000100:00100000:3.0:1789892526.371078:0:189441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842560 00000100:00100000:3.0:1789892526.371084:0:189441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842560 00000100:00100000:1.0:1789892526.371104:0:190971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789892526.371123:0:190971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3619:x1876834915842176:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892526.371134:0:193748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789892526.371136:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789892526.371162:0:189441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789892526.371163:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915842304:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892526.371164:0:193748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+12:3622:x1876834915842048:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892526.371184:0:189441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+12:3620:x1876834915842816:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892526.371213:0:190971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3619:x1876834915842176:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000004:00000024:2.0:1789892526.371224:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:1.0:1789892526.371232:0:190971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789892526.371254:0:189441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876834915842816:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.371265:0:189441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789892526.371286:0:190971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789892526.371286:0:193748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+12:3622:x1876834915842048:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.371300:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915842304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.371315:0:190971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+12:3622:x1876834915842560:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892526.371324:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789892526.371324:0:193748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789892526.371346:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915842304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789892526.371388:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876834915842816:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892526.371396:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.371419:0:190971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3622:x1876834915842560:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 102us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.371432:0:190971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789892526.371441:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.371460:0:189441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842432 00000100:00100000:3.0:1789892526.371465:0:189441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842432 00000100:00100000:1.0:1789892526.371535:0:190971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842688 00000100:00100000:1.0:1789892526.371543:0:190971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842688 00000100:00100000:2.0:1789892526.371552:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915842176:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892526.371566:0:189441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789892526.371584:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915842048:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892526.371604:0:189441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915842432:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892526.371616:0:190971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789892526.371626:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915842560:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892526.371635:0:190971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915842688:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892526.371690:0:189441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915842432:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.371697:0:189441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789892526.371744:0:190971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915842688:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 116us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.371746:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915842432:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892526.371759:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915842688:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892526.371778:0:190971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 10000000:01000000:0.0:1789892526.394624:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892526.394633:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 150 10000000:01000000:0.0:1789892526.394641:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892526.394698:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.394726:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.394740:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.394767:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915842944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.394836:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.394889:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.394921:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915842944 00000100:00100000:3.0:1789892526.394934:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915842944 00000100:00100000:3.0:1789892526.394989:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1789892526.394997:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915842944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.395010:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.395028:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002130f7 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.395075:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.395088:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.395098:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fc00, rc 0) 00000100:00100000:3.0:1789892526.395171:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915842944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.395180:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1789892526.395218:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915842944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892526.395242:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.395253:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.395329:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.395361:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.395383:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.395408:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843072 00000100:00100000:3.0:1789892526.395414:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843072 00000100:00100000:3.0:1789892526.395438:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1789892526.395443:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915843072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.395596:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915843072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.395602:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:0.0:1789892526.395641:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.395677:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.395729:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.395759:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.395773:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843200 00000100:00100000:3.0:1789892526.395778:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843200 00000100:00100000:3.0:1789892526.395805:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:3.0:1789892526.395809:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915843200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.395891:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915843200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.395896:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:0.0:1789892526.395940:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.396290:0:213725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213725:1876834915843328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.396336:0:213725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.396356:0:213725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.396385:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843328 00000100:00100000:3.0:1789892526.396391:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843328 00000100:00100000:3.0:1789892526.396420:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:3.0:1789892526.396424:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213725:x1876834915843328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.396527:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213725:x1876834915843328:12345-0@lo:502:llog_process_th.0 Request processed in 98us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.396532:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1789892526.396558:0:213725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213725:1876834915843328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.396630:0:213725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213725:1876834915843456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.396673:0:213725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.396706:0:213725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.396721:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843456 00000100:00100000:3.0:1789892526.396727:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843456 00000100:00100000:3.0:1789892526.396753:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:3.0:1789892526.396758:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213725:x1876834915843456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.396822:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213725:x1876834915843456:12345-0@lo:502:llog_process_th.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.396831:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1789892526.396864:0:213725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213725:1876834915843456:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892526.396895:0:213725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:2.0:1789892526.397015:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:2.0:1789892526.397049:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892526.397056:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.397065:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892526.397073:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892526.397074:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:2.0:1789892526.397076:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892526.397094:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.397100:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.397106:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.397117:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.397148:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.397166:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.397195:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843584 00000100:00100000:3.0:1789892526.397201:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843584 00000100:00100000:3.0:1789892526.397225:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:3.0:1789892526.397230:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915843584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.397236:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.397246:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213105 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.397258:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.397265:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.397270:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ec00, rc 0) 00000100:00100000:3.0:1789892526.397303:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915843584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.397315:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1789892526.397332:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892526.397346:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.397369:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.397416:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.397442:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.397457:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.397487:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843712 00000100:00100000:3.0:1789892526.397509:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843712 00000100:00100000:3.0:1789892526.397540:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:3.0:1789892526.397556:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915843712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.397642:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915843712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.397647:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1789892526.397672:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.397700:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.397743:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.397763:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.397790:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843840 00000100:00100000:3.0:1789892526.397795:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843840 00000100:00100000:3.0:1789892526.397818:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:3.0:1789892526.397824:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915843840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.397901:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915843840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.397909:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00100000:2.0:1789892526.397918:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892526.398535:0:213726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:0.0:1789892526.398610:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:0.0:1789892526.398642:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892526.398649:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.398658:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892526.398666:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892526.398669:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 150 10000000:01000000:0.0:1789892526.398671:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892526.398687:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.398696:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.398704:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.398729:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.398761:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.398789:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.398813:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915843968 00000100:00100000:3.0:1789892526.398820:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915843968 00000100:00100000:3.0:1789892526.398849:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:3.0:1789892526.398855:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915843968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.398863:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.398871:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213113 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.398885:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.398891:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.398903:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f800, rc 0) 00000100:00100000:3.0:1789892526.398942:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915843968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.398948:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:0.0:1789892526.398982:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915843968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892526.398997:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.399007:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.399050:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.399082:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.399103:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.399137:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844096 00000100:00100000:3.0:1789892526.399143:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844096 00000100:00100000:3.0:1789892526.399176:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:3.0:1789892526.399185:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915844096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.399296:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915844096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.399303:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1789892526.399324:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.399351:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.399389:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.399407:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.399428:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844224 00000100:00100000:3.0:1789892526.399433:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844224 00000100:00100000:3.0:1789892526.399454:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:3.0:1789892526.399459:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915844224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.399551:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915844224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.399557:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:0.0:1789892526.399579:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.399753:0:213727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213727:1876834915844352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.399789:0:213727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.399813:0:213727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.399824:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844352 00000100:00100000:3.0:1789892526.399829:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844352 00000100:00100000:3.0:1789892526.399850:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1789892526.399854:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213727:x1876834915844352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.399918:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213727:x1876834915844352:12345-0@lo:502:llog_process_th.0 Request processed in 63us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.399925:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:0.0:1789892526.399937:0:213727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213727:1876834915844352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.399978:0:213727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213727:1876834915844480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.400017:0:213727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.400034:0:213727:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.400040:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844480 00000100:00100000:3.0:1789892526.400044:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844480 00000100:00100000:3.0:1789892526.400064:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1789892526.400069:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213727:x1876834915844480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.400120:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213727:x1876834915844480:12345-0@lo:502:llog_process_th.0 Request processed in 51us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.400127:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:0.0:1789892526.400143:0:213727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213727:1876834915844480:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892526.400167:0:213727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:2.0:1789892526.400235:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:2.0:1789892526.400255:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892526.400260:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.400268:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892526.400274:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892526.400276:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:2.0:1789892526.400277:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892526.400291:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.400306:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.400313:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.400333:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.400358:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.400374:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.400392:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844608 00000100:00100000:3.0:1789892526.400396:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844608 00000100:00100000:3.0:1789892526.400415:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1789892526.400420:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915844608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.400426:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.400436:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213121 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.400450:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.400458:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.400464:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f000, rc 0) 00000100:00100000:3.0:1789892526.400512:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915844608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.400516:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1789892526.400522:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892526.400533:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.400541:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.400589:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.400611:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.400634:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.400638:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844736 00000100:00100000:3.0:1789892526.400642:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844736 00000100:00100000:3.0:1789892526.400662:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:3.0:1789892526.400667:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915844736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.400740:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915844736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.400748:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1789892526.400748:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.400786:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.400816:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.400829:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.400845:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844864 00000100:00100000:3.0:1789892526.400848:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844864 00000100:00100000:3.0:1789892526.400865:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:3.0:1789892526.400870:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915844864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.400926:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915844864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.400932:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:2.0:1789892526.400940:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892526.401483:0:213728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:1.0:1789892526.401599:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892526.401640:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892526.401651:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.401671:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892526.401682:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892526.401684:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 150 10000000:01000000:1.0:1789892526.401687:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892526.401710:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.401716:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.401723:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.401740:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.401777:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.401806:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.401832:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915844992 00000100:00100000:3.0:1789892526.401838:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915844992 00000100:00100000:3.0:1789892526.401861:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:3.0:1789892526.401866:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915844992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.401872:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.401880:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021312f expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.401891:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.401898:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.401902:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e200, rc 0) 00000100:00100000:3.0:1789892526.401934:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915844992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.401949:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:1.0:1789892526.401983:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915844992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892526.401999:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.402007:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.402052:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.402084:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.402106:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.402130:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845120 00000100:00100000:3.0:1789892526.402136:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845120 00000100:00100000:3.0:1789892526.402157:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1789892526.402162:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915845120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.402219:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915845120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.402224:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:1.0:1789892526.402259:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.402287:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.402322:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.402335:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.402356:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845248 00000100:00100000:3.0:1789892526.402361:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845248 00000100:00100000:3.0:1789892526.402383:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1789892526.402389:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915845248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.402456:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915845248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.402461:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:1.0:1789892526.402553:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.402882:0:213729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213729:1876834915845376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.402918:0:213729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.402944:0:213729:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a407540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.402988:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845376 00000100:00100000:2.0:1789892526.402994:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845376 00000100:00100000:2.0:1789892526.403025:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:2.0:1789892526.403033:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213729:x1876834915845376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892526.403107:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213729:x1876834915845376:12345-0@lo:502:llog_process_th.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.403113:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:3.0:1789892526.403118:0:213729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213729:1876834915845376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.403153:0:213729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213729:1876834915845504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.403179:0:213729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.403193:0:213729:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892526.403217:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845504 00000100:00100000:0.0:1789892526.403223:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845504 00000100:00100000:0.0:1789892526.403254:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:0.0:1789892526.403262:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213729:x1876834915845504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.403344:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213729:x1876834915845504:12345-0@lo:502:llog_process_th.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.403353:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:3.0:1789892526.403356:0:213729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213729:1876834915845504:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892526.403381:0:213729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:1.0:1789892526.403471:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:1.0:1789892526.403548:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892526.403557:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.403567:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892526.403588:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892526.403591:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 172 10000000:01000000:1.0:1789892526.403593:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892526.403614:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.403622:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.403630:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.403646:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.403682:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.403731:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845632 00000100:00100000:2.0:1789892526.403736:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845632 00000100:00100000:1.0:1789892526.403738:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.403776:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1789892526.403783:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915845632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892526.403790:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892526.403798:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021313d expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.403811:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.403818:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.403823:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892526.403857:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915845632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.403861:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:1.0:1789892526.403909:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892526.403926:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.403935:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.403981:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.404015:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.404034:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892526.404063:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845760 00000100:00100000:0.0:1789892526.404071:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845760 00000100:00100000:0.0:1789892526.404104:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:0.0:1789892526.404112:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915845760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.404200:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915845760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.404209:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:1.0:1789892526.404236:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.404259:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.404294:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.404309:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.404331:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915845888 00000100:00100000:2.0:1789892526.404337:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915845888 00000100:00100000:2.0:1789892526.404359:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1789892526.404364:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915845888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.404457:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915845888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.404467:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1789892526.404472:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915845888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.404737:0:213730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213730:1876834915846016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.404785:0:213730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.404816:0:213730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.404857:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846016 00000100:00100000:3.0:1789892526.404863:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846016 00000100:00100000:3.0:1789892526.404889:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:3.0:1789892526.404895:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213730:x1876834915846016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.404973:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213730:x1876834915846016:12345-0@lo:502:llog_process_th.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.404978:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:0.0:1789892526.405005:0:213730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213730:1876834915846016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892526.405032:0:213730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892526.405044:0:213730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892526.405047:0:213730:0:(obd_config.c:1561:class_process_config()) marker 162 (0x1) lustre-MDT0001-m del lustre.qpool1 00000020:00000080:0.0:1789892526.405058:0:213730:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892526.405146:0:213730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213730:1876834915846144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.405182:0:213730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.405201:0:213730:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.405212:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846144 00000100:00100000:2.0:1789892526.405217:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846144 00000100:00100000:2.0:1789892526.405241:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1789892526.405245:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213730:x1876834915846144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892526.405305:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213730:x1876834915846144:12345-0@lo:502:llog_process_th.0 Request processed in 59us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.405312:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1789892526.405326:0:213730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213730:1876834915846144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892526.405352:0:213730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892526.405357:0:213730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892526.405358:0:213730:0:(obd_config.c:1561:class_process_config()) marker 162 (0x2) lustre-MDT0001-m del lustre.qpool1 00000040:00080000:0.0:1789892526.405362:0:213730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 175 count 172 00000020:01000000:1.0:1789892526.405431:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 172-174 (rc=0) 10000000:01000000:1.0:1789892526.405453:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892526.405458:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.405464:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892526.405470:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892526.405471:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 150 10000000:01000000:1.0:1789892526.405472:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892526.405524:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.405533:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.405543:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.405562:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.405613:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.405650:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.405653:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846272 00000100:00100000:3.0:1789892526.405659:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846272 00000100:00100000:3.0:1789892526.405688:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1789892526.405694:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915846272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.405700:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.405708:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021314b expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.405722:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.405728:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.405733:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e600, rc 0) 00000100:00100000:3.0:1789892526.405765:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915846272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.405770:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:1.0:1789892526.405802:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892526.405816:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892526.405826:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892526.405865:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.405889:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.405903:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.405922:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846400 00000100:00100000:2.0:1789892526.405928:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846400 00000100:00100000:2.0:1789892526.405953:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1789892526.405957:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915846400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.406023:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915846400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.406029:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:1.0:1789892526.406058:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.406084:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.406120:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.406140:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.406155:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846528 00000100:00100000:3.0:1789892526.406161:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846528 00000100:00100000:3.0:1789892526.406189:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:3.0:1789892526.406194:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915846528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.406272:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915846528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.406280:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:1.0:1789892526.406289:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892526.406548:0:213731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213731:1876834915846656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892526.406606:0:213731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.406637:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846656 00000100:00100000:1.0:1789892526.406641:0:213731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.406643:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846656 00000100:00100000:2.0:1789892526.406676:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:2.0:1789892526.406681:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213731:x1876834915846656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892526.406750:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213731:x1876834915846656:12345-0@lo:502:llog_process_th.0 Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.406756:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1789892526.406773:0:213731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213731:1876834915846656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892526.406817:0:213731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213731:1876834915846784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892526.406846:0:213731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.406861:0:213731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.406875:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846784 00000100:00100000:3.0:1789892526.406881:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846784 00000100:00100000:3.0:1789892526.406905:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1789892526.406911:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213731:x1876834915846784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.406978:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213731:x1876834915846784:12345-0@lo:502:llog_process_th.0 Request processed in 66us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.406986:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1789892526.407005:0:213731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213731:1876834915846784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892526.407030:0:213731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:0.0:1789892526.407106:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:0.0:1789892526.407145:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892526.407153:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.407163:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892526.407173:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892526.407175:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 172 10000000:01000000:0.0:1789892526.407178:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892526.407198:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.407207:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.407216:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.407232:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.407270:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.407292:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.407304:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915846912 00000100:00100000:2.0:1789892526.407308:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915846912 00000100:00100000:2.0:1789892526.407337:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:2.0:1789892526.407341:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915846912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892526.407347:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892526.407354:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213159 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.407366:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.407372:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.407378:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe600, rc 0) 00000100:00100000:2.0:1789892526.407404:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915846912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.407408:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:0.0:1789892526.407437:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915846912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892526.407451:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892526.407460:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892526.407547:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.407590:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.407617:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847040 00000100:00100000:3.0:1789892526.407622:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847040 00000100:00100000:0.0:1789892526.407622:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.407648:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:3.0:1789892526.407653:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915847040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.407708:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915847040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.407713:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:0.0:1789892526.407738:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.407763:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.407804:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.407824:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.407825:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847168 00000100:00100000:2.0:1789892526.407830:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847168 00000100:00100000:2.0:1789892526.407852:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1789892526.407858:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915847168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.407915:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915847168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.407923:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:0.0:1789892526.407938:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892526.408141:0:213732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213732:1876834915847296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.408176:0:213732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.408196:0:213732:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.408204:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847296 00000100:00100000:3.0:1789892526.408208:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847296 00000100:00100000:3.0:1789892526.408228:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:3.0:1789892526.408232:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213732:x1876834915847296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892526.408300:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213732:x1876834915847296:12345-0@lo:502:llog_process_th.0 Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.408307:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1789892526.408322:0:213732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213732:1876834915847296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892526.408348:0:213732:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892526.408355:0:213732:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892526.408357:0:213732:0:(obd_config.c:1561:class_process_config()) marker 161 (0x1) lustre-MDT0000-m del lustre.qpool1 00000020:00000080:0.0:1789892526.408361:0:213732:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892526.409255:0:213732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213732:1876834915847424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892526.409291:0:213732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.409342:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847424 00000100:00100000:2.0:1789892526.409349:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847424 00000100:00100000:0.0:1789892526.409351:0:213732:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892526.409396:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1789892526.409408:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213732:x1876834915847424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892526.409542:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213732:x1876834915847424:12345-0@lo:502:llog_process_th.0 Request processed in 135us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.409554:0:213732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213732:1876834915847424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892526.409563:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000020:01000000:0.0:1789892526.409595:0:213732:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892526.409600:0:213732:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892526.409602:0:213732:0:(obd_config.c:1561:class_process_config()) marker 161 (0x2) lustre-MDT0000-m del lustre.qpool1 00000040:00080000:0.0:1789892526.409606:0:213732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 175 count 172 00000020:01000000:2.0:1789892526.409667:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 172-174 (rc=0) 10000000:01000000:2.0:1789892526.409696:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892526.409702:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.409710:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892526.409716:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892526.409717:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892526.409718:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892526.409731:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.409737:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.409742:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.409752:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.409777:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.409813:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847552 00000100:00100000:3.0:1789892526.409818:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847552 00000100:00100000:2.0:1789892526.409818:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.409849:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:3.0:1789892526.409857:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915847552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892526.409863:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892526.409870:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213167 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.409881:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.409887:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892526.409892:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f600, rc 0) 00000100:00100000:3.0:1789892526.409935:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915847552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.409942:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1789892526.409965:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892526.409984:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.410010:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.410060:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892526.410090:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.410110:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892526.410121:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847680 00000100:00100000:3.0:1789892526.410125:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847680 00000100:00100000:3.0:1789892526.410144:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:3.0:1789892526.410149:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915847680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892526.410188:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915847680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 40us (98us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892526.410194:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1789892526.410205:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915847680:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892526.410230:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892526.410236:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892526.410244:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892526.882772:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915848192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789892526.882781:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892526.882781:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915847808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892526.882856:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915848064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892526.882897:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.882902:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915847936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892526.882948:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.882974:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915848704:0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.883008:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.883009:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848192 00000100:00100000:3.0:1789892526.883016:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915848576:0@lo:400:kworker.0 00000100:00100000:1.0:1789892526.883021:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848192 00000100:00100000:2.0:1789892526.883029:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.883055:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915848320:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.883092:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915849216:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.883093:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.883112:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848064 00000100:00100000:1.0:1789892526.883121:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848064 00000100:00100000:0.0:1789892526.883122:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.883131:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915849088:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.883143:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.883184:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847808 00000100:00100000:1.0:1789892526.883190:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847808 00000100:00100000:3.0:1789892526.883198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.883198:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915848832:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.883204:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915849728:0@lo:400:kworker.0 00000100:00100000:1.0:1789892526.883231:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789892526.883246:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915848192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892526.883260:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915849600:0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.883262:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.883270:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848704 00000100:00100000:2.0:1789892526.883279:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848704 00002000:00000024:1.0:1789892526.883298:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892526.883310:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915849344:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.883323:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.883347:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848576 00000100:00100000:2.0:1789892526.883363:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848576 00000100:00100000:0.0:1789892526.883364:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.883382:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1876834915848192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.883394:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789892526.883399:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915849856:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.883411:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849216 00000100:00100000:3.0:1789892526.883419:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789892526.883419:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849216 00000100:00100000:1.0:1789892526.883433:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789892526.883441:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915848064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892526.883442:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.883453:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876834915847808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892526.883457:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849088 00000100:00100000:2.0:1789892526.883464:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849088 00002000:00000024:3.0:1789892526.883485:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789892526.883487:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789892526.883517:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789892526.883525:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892526.883549:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789892526.883549:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.883584:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915848704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.883591:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915848448:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.883632:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1876834915848064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.883642:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789892526.883654:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892526.883665:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876834915847808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.883670:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915847936 00000100:00100000:2.0:1789892526.883676:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915848704:12345-0@lo:400:kworker.0 Request processed in 111us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.883677:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915847936 00000100:00100000:1.0:1789892526.883685:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789892526.883692:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915848960:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.883700:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789892526.883723:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789892526.883740:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892526.883744:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1876834915847936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892526.883753:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00002000:00000024:3.0:1789892526.883758:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892526.883775:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915848576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.883792:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915849472:0@lo:400:kworker.0 00000100:00100000:1.0:1789892526.883794:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789892526.883821:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1876834915847936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.883824:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876834915849216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.883837:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789892526.883843:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915848576:12345-0@lo:400:kworker.0 Request processed in 73us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.883843:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892526.883856:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789892526.883873:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848832 00000100:00100000:3.0:1789892526.883878:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848832 00000100:00100000:2.0:1789892526.883887:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789892526.883903:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915849088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.883923:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849600 00000100:00100000:1.0:1789892526.883926:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915849216:12345-0@lo:400:kworker.0 Request processed in 113us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892526.883927:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915847936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892526.883931:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849600 00000100:00100000:1.0:1789892526.883954:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789892526.883959:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915849088:12345-0@lo:400:kworker.0 Request processed in 59us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.883974:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789892526.883986:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848448 00000100:00100000:3.0:1789892526.883987:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849344 00000100:00100000:0.0:1789892526.883992:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848448 00000100:00100000:3.0:1789892526.883993:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849344 00000100:00100000:1.0:1789892526.884017:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849856 00000100:00100000:1.0:1789892526.884024:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849856 00000100:00100000:3.0:1789892526.884027:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849472 00000100:00100000:3.0:1789892526.884031:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849472 00000100:00100000:2.0:1789892526.884042:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892526.884043:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848960 00000100:00100000:0.0:1789892526.884048:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848960 00000100:00100000:0.0:1789892526.884081:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789892526.884094:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915849728 00000100:00100000:0.0:1789892526.884095:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915848448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.884099:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915849728 00000100:00100000:2.0:1789892526.884103:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915848192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892526.884107:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789892526.884130:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915848832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.884135:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915848704:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.884142:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1789892526.884150:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915848448:12345-0@lo:400:kworker.0 Request processed in 58us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.884163:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915849600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884163:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789892526.884205:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789892526.884214:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915849216:0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884232:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892526.884233:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915848832:12345-0@lo:400:kworker.0 Request processed in 95us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.884252:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915849600:12345-0@lo:400:kworker.0 Request processed in 86us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.884272:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789892526.884287:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1789892526.884300:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915848960:12345-0@lo:400:kworker.0 Request processed in 81us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.884302:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789892526.884313:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789892526.884317:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789892526.884329:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915849344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.884344:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1789892526.884345:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915849856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884367:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1789892526.884368:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915849472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884381:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915849728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892526.884460:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915849856:12345-0@lo:400:kworker.0 Request processed in 124us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.884469:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915849472:12345-0@lo:400:kworker.0 Request processed in 105us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.884472:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1789892526.884480:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915849728:12345-0@lo:400:kworker.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892526.884483:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915849344:12345-0@lo:400:kworker.0 Request processed in 158us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892526.884531:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789892526.884543:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789892526.884556:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1789892526.884595:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915849344:0@lo:400:kworker.0 00000100:00080000:0.0:1789892526.884611:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892526.884619:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915848320 00000100:00080000:0.0:1789892526.884622:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892526.884627:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915848320 00010000:00080000:1.0:1789892526.884635:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9069af5b6d80 x1876834915849856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892526.884639:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915848064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892526.884664:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915848448:0@lo:400:kworker.0 00000100:00100000:1.0:1789892526.884673:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915849856:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.884677:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915848576:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.884677:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:2.0:1789892526.884696:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915848320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884696:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915848960:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.884708:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915849088:0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884736:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915849472:0@lo:400:kworker.0 00010000:00080000:3.0:1789892526.884738:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9069b5407480 x1876834915849600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892526.884739:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915847808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892526.884764:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915848320:12345-0@lo:400:kworker.0 Request processed in 67us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892526.884782:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915848320:0@lo:400:kworker.0 00000100:00100000:3.0:1789892526.884787:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915849600:0@lo:400:kworker.0 00000100:00100000:2.0:1789892526.884797:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:1.0:1789892526.884835:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915848832:0@lo:400:kworker.0 00000100:00100000:0.0:1789892526.884849:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915849728:0@lo:400:kworker.0 00010000:00010000:0.0:1789892527.906780:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892528.207697:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892528.207775:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925840896 00000100:00100000:3.0:1789892528.207792:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925840896 00000100:00100000:3.0:1789892528.207861:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1882 00000100:00100000:3.0:1789892528.207880:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925840896:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892528.207899:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892528.207918:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5a4 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892528.207970:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892528.207982:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892528.207993:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fe00, rc 0) 00000100:00100000:3.0:1789892528.208079:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925840896:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 208us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892528.208088:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1882 00000100:00100000:3.0:1789892528.209477:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892528.209569:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841024 00000100:00100000:2.0:1789892528.209582:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841024 00000100:00100000:2.0:1789892528.209649:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1883 00000100:00100000:2.0:1789892528.209663:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925841024:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892528.209871:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925841024:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 210us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892528.209885:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1883 00000100:00100000:1.0:1789892528.210901:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892528.210958:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841152 00000100:00100000:3.0:1789892528.210967:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841152 00000100:00100000:3.0:1789892528.211009:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1884 00000100:00100000:3.0:1789892528.211018:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925841152:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892528.211144:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925841152:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 125us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892528.211152:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1884 00000100:00100000:3.0:1789892528.212710:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892528.212769:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841280 00000100:00100000:2.0:1789892528.212779:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841280 00000100:00100000:2.0:1789892528.212820:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1885 00000100:00100000:2.0:1789892528.212834:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212841:x1876834925841280:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892528.212966:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212841:x1876834925841280:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 135us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892528.212977:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1885 00000100:00100000:0.0:1789892528.213907:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892528.213962:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841408 00000100:00100000:3.0:1789892528.213970:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841408 00000100:00100000:3.0:1789892528.214009:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1886 00000100:00100000:3.0:1789892528.214016:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212841:x1876834925841408:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892528.214134:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212841:x1876834925841408:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 116us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892528.214156:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1886 00000100:00100000:1.0:1789892528.215440:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892528.215528:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841536 00000100:00100000:2.0:1789892528.215551:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841536 00000100:00100000:2.0:1789892528.215594:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1887 00000100:00100000:2.0:1789892528.215606:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925841536:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892528.215619:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892528.215639:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5ab expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892528.215667:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892528.215681:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892528.215692:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff000, rc 0) 00000100:00100000:2.0:1789892528.215737:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925841536:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 134us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892528.215746:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1887 00000100:00100000:2.0:1789892528.216611:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892528.216664:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841664 00000100:00100000:3.0:1789892528.216673:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841664 00000100:00100000:3.0:1789892528.216713:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1888 00000100:00100000:3.0:1789892528.216722:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925841664:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892528.216807:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925841664:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 85us (196us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892528.216815:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1888 00010000:00010000:2.0:1789892528.931733:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892529.039218:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892529.039271:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892529.039273:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841792 00000100:00100000:3.0:1789892529.039288:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841792 00000100:00100000:0.0:1789892529.039305:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892529.039345:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925841920 00000100:00100000:1.0:1789892529.039347:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842048 00000100:00100000:0.0:1789892529.039351:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925841920 00000100:00100000:1.0:1789892529.039356:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842048 00000100:00100000:3.0:1789892529.039366:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1889 00000100:00100000:3.0:1789892529.039382:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2401:x1876834925841792:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892529.039423:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 441 00000100:00100000:1.0:1789892529.039432:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 442 00000100:00100000:0.0:1789892529.039439:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:2402:x1876834925841920:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892529.039446:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925842048:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1789892529.039481:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2401:x1876834925841792:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892529.039514:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925842048:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892529.039541:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1889 00000100:00100000:1.0:1789892529.039543:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 442 00000100:00100000:0.0:1789892529.039547:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:2402:x1876834925841920:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892529.039559:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 441 00000100:00080000:0.0:1789892529.039591:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789892529.039597:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1789892529.466442:0:213926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff216b2130 20000000:00000080:3.0:1789892529.466458:0:213926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9069af5d1c00 uarg=0000000000000000 00000040:00100000:3.0:1789892529.467099:0:213926:0:(llog.c:1072:llog_reverse_process()) index 152 : idx 137 20000000:01000000:3.0:1789892529.467107:0:213926:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 142 cmd:0xce021 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:3.0:1789892529.467121:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789892529.467533:0:213927:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 141 marker 151 1->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:0.0:1789892529.467598:0:213927:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 143 marker 151 2->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789892529.467611:0:213927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000040:00080000:3.0:1789892529.467797:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].153, 224 off36048 20000000:01000000:3.0:1789892529.467819:0:213926:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789892529.467836:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].154, 128 off36176 00000040:00080000:3.0:1789892529.467855:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].155, 224 off36400 20000000:01000000:3.0:1789892529.467869:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789892529.468185:0:213928:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 163 marker 152 1->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:0.0:1789892529.468208:0:213928:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 152 2->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789892529.468219:0:213928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 175 count 172 00000040:00080000:3.0:1789892529.468337:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].175, 224 off40216 20000000:01000000:3.0:1789892529.468360:0:213926:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789892529.468378:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].176, 136 off40352 00000040:00080000:3.0:1789892529.468395:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].177, 224 off40576 20000000:01000000:3.0:1789892529.468408:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789892529.468676:0:213929:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 163 marker 153 1->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:0.0:1789892529.468698:0:213929:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 153 2->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789892529.468708:0:213929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 175 count 172 00000040:00080000:3.0:1789892529.468811:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].175, 224 off40216 20000000:01000000:3.0:1789892529.468824:0:213926:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789892529.468841:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].176, 136 off40352 00000040:00080000:3.0:1789892529.468858:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].177, 224 off40576 10000000:01000000:3.0:1789892529.468870:0:213926:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789892529.468890:0:213926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468910:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468919:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468926:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468932:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468939:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468946:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468953:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468968:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468975:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468985:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468992:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.468999:0:213926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.469040:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.469055:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 9 pid: 189433 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.469071:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915849984:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892529.469179:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.469189:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 9 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.469200:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850112:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892529.469250:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.469260:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 23 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.469270:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850240:0@lo:104: 00000100:00100000:3.0:1789892529.469329:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892529.469390:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915850240 00000100:00100000:2.0:1789892529.469404:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915850240 00000100:00100000:2.0:1789892529.469472:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789892529.469532:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850240:12345-0@lo:104: 00010000:00010000:2.0:1789892529.469555:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.469593:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.469607:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 23 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.469618:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850368:0@lo:104: 00010000:00010000:2.0:1789892529.469663:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892529.469666:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892529.469679:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789892529.469683:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850240:12345-0@lo:104: Request processed in 197us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892529.469689:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.469694:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00010000:00010000:0.0:1789892529.469706:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe400 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892529.469711:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.469720:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.469723:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915850368 10000000:00010000:0.0:1789892529.469728:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.469732:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915850368 10000000:01000000:0.0:1789892529.469737:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892529.469785:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.469789:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00010000:00010000:0.0:1789892529.469798:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892529.469812:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850368:12345-0@lo:104: 00010000:00010000:2.0:1789892529.469824:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.469827:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.469845:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021316e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.469846:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915850496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892529.469860:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.469878:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892529.469880:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 23 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.469881:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.469887:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892529.469900:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892529.469907:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850624:0@lo:104: 00000100:00100000:2.0:1789892529.469910:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850368:12345-0@lo:104: Request processed in 105us (244us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892529.469919:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892529.469922:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892529.469931:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.469937:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:0.0:1789892529.469945:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892529.469954:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.469961:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892529.469969:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892529.469974:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892529.469984:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915850496 00000100:00100000:3.0:1789892529.469985:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892529.469992:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915850496 00010000:00010000:0.0:1789892529.470003:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.470012:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892529.470017:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 24 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.470026:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915850624 00000100:00100000:1.0:1789892529.470033:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915850624 00010000:00010000:0.0:1789892529.470043:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.470050:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 24 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.470062:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00010000:00010000:0.0:1789892529.470062:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd00213159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213160 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.470071:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789892529.470084:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915850496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892529.470087:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.470090:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850624:12345-0@lo:104: 00010000:00010000:0.0:1789892529.470098:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.470103:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.470110:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892529.470115:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.470119:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892529.470132:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 24 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.470134:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915850752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.470166:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892529.470175:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850624:12345-0@lo:104: Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892529.470183:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850880:0@lo:104: 00000100:00100000:1.0:1789892529.470191:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:2.0:1789892529.470193:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 24 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.470206:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892529.470222:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892529.470229:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892529.470230:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470238:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892529.470242:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470249:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892529.470255:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892529.470259:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892529.470286:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.470289:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915850496:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (378us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892529.470296:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892529.470301:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915850752 00000100:00100000:2.0:1789892529.470306:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1789892529.470309:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915850752 00010000:00010000:1.0:1789892529.470315:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470322:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021314b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213152 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470335:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.470336:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470338:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892529.470343:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892529.470345:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892529.470370:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915851008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.470376:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915850880 00000100:00100000:1.0:1789892529.470382:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915850880 00000100:00100000:0.0:1789892529.470392:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00010000:00010000:3.0:1789892529.470417:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.470418:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789892529.470418:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915850752:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892529.470437:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.470448:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850880:12345-0@lo:104: 00010000:00010000:0.0:1789892529.470448:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892529.470461:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470463:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.470535:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851008 00000100:00100000:2.0:1789892529.470541:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851008 00010000:00010000:2.0:1789892529.470560:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 25 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.470597:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00010000:00010000:1.0:1789892529.470609:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892529.470610:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915851008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.470617:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915850880:12345-0@lo:104: Request processed in 175us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892529.470624:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00010000:00010000:2.0:1789892529.470625:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892529.470633:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 25 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470641:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892529.470645:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470651:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800e00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892529.470654:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470659:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892529.470663:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892529.470667:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892529.470685:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470690:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892529.470702:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.470709:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 25 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470748:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021313d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213144 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.470757:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 25 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.470760:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892529.470761:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688e9b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851136:0@lo:104: 00010000:00010000:1.0:1789892529.470766:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892529.470772:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892529.470790:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 25 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.470790:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915851264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892529.470820:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892529.470821:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892529.470830:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.470839:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892529.470900:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3619:x1876834915850752:12345-0@lo:103:ldlm_bl.0 Request processed in 486us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892529.470910:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915851008:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (483us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892529.470913:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 25 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.470914:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789892529.470938:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915850496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892529.470941:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1789892529.470941:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851264 00000100:00100000:0.0:1789892529.470953:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851264 00010000:00010000:3.0:1789892529.470959:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.470976:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.470984:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851392:0@lo:104: 00000100:00100000:2.0:1789892529.471004:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915850752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.471017:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851136 00000100:00100000:0.0:1789892529.471017:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789892529.471026:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851136 00000100:00100000:0.0:1789892529.471037:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915851264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892529.471047:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915851008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892529.471050:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892529.471064:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892529.471067:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471074:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00010000:00010000:0.0:1789892529.471086:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 24 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471094:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915851136:12345-0@lo:104: 00000100:00100000:2.0:1789892529.471095:0:193633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789892529.471106:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892529.471109:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.471114:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851392 00000100:00100000:2.0:1789892529.471125:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851392 00010000:00010000:3.0:1789892529.471128:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.471145:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 24 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.471162:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851520:0@lo:104: 00000100:00100000:2.0:1789892529.471167:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789892529.471179:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915851264:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (343us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892529.471181:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892529.471189:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906886fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213926:x1876834915851392:12345-0@lo:104: 00000100:00100000:1.0:1789892529.471196:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213926:x1876834915851136:12345-0@lo:104: Request processed in 107us (374us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892529.471208:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.471209:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789892529.471214:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789892529.471227:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.471249:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851520 00000100:00100000:1.0:1789892529.471258:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851520 00010000:00010000:3.0:1789892529.471282:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471292:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00010000:00010000:2.0:1789892529.471296:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892529.471307:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906886fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213926:x1876834915851392:12345-0@lo:104: Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892529.471309:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:213926:x1876834915851520:12345-0@lo:104: 00000100:00100000:0.0:1789892529.471332:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892529.471337:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00010000:1.0:1789892529.471342:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.471361:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 23 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.471391:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789892529.471397:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1789892529.471404:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.471413:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892529.471417:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.471421:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851648:0@lo:104: 00010000:00010000:2.0:1789892529.471428:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892529.471436:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892529.471441:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892529.471459:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892529.471469:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471470:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915851520:12345-0@lo:104: Request processed in 165us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892529.471485:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915851264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892529.471524:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892529.471538:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.471551:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.471556:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00010000:00010000:2.0:1789892529.471569:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021312f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213136 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.471586:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789892529.471588:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892529.471590:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851648 00010000:00010000:2.0:1789892529.471592:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471594:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851648 00000100:00100000:0.0:1789892529.471599:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915851776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892529.471610:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffe00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892529.471616:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.471627:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892529.471634:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892529.471639:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892529.471652:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789892529.471655:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.471663:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915851648:12345-0@lo:104: 00010000:00010000:2.0:1789892529.471671:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.471674:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.471680:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.471689:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892529.471709:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.471712:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892529.471715:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 23 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.471722:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.471733:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892529.471745:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213128 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471753:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915851648:12345-0@lo:104: Request processed in 88us (273us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892529.471771:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837c00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892529.471783:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471784:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00010000:00010000:0.0:1789892529.471795:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.471796:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915852032:0@lo:104: 00010000:00010000:2.0:1789892529.471796:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892529.471805:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892529.471814:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892529.471817:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.471825:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789892529.471834:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892529.471838:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892529.471846:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.471856:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.471862:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.471863:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.471869:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842304 00000100:00100000:1.0:1789892529.471876:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842304 00010000:00010000:0.0:1789892529.471886:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789892529.471889:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.471898:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 10 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.471899:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892529.471900:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892529.471909:0:213926:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069b2488900 going to sleep for 11 seconds 00010000:00010000:0.0:1789892529.471941:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021311a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471943:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842176 00010000:00010000:2.0:1789892529.471944:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.471953:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842176 00000100:00100000:3.0:1789892529.471954:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915849984:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892529.471958:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.471964:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.471972:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892529.471975:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892529.471977:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 11 pid: 189433 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.471994:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852032 00000100:00100000:3.0:1789892529.472000:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850112:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892529.472000:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852032 00000100:00100000:1.0:1789892529.472007:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851776 00010000:00010000:2.0:1789892529.472010:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.472020:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851776 00010000:00010000:2.0:1789892529.472024:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021310c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.472026:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f600/0x5c4f93dd0021316e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213167 expref: 23 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472043:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 24 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.472048:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00010000:00010000:2.0:1789892529.472067:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892529.472073:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915852032:12345-0@lo:104: 00010000:00010000:2.0:1789892529.472076:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892529.472086:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892529.472086:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.472092:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850240:0@lo:104: 00000100:00100000:1.0:1789892529.472102:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 444 00000100:00100000:2.0:1789892529.472108:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915851904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.472125:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925842304:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.472136:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892529.472141:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 11 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.472149:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213159 expref: 23 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472155:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 11 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.472166:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892529.472179:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892529.472186:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:213926:x1876834915852032:12345-0@lo:104: Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892529.472190:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850368:0@lo:104: 00010000:00010000:1.0:1789892529.472198:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5a4 expref: 11 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.472206:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789892529.472211:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789892529.472227:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915852160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.472231:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892529.472234:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e600/0x5c4f93dd00213152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021314b expref: 22 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.472254:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915851904 00000100:00100000:0.0:1789892529.472259:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915851904 00000100:00100000:1.0:1789892529.472273:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925842304:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 152us (948us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892529.472279:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 23 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.472300:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892529.472306:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 444 00000100:00100000:3.0:1789892529.472307:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850624:0@lo:104: 00000100:00100000:0.0:1789892529.472334:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852160 00000100:00100000:0.0:1789892529.472341:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852160 00000100:00100000:1.0:1789892529.472347:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 445 00010000:00010000:3.0:1789892529.472353:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021313d expref: 23 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.472360:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915852288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892529.472364:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 23 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.472365:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc396450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2399:x1876834925842176:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.472391:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892529.472402:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 9 pid: 189433 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.472410:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915850880:0@lo:104: 00010000:00010000:1.0:1789892529.472418:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 9 pid: 189433 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892529.472424:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892529.472426:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789892529.472444:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915851776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.472461:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff000/0x5c4f93dd0021317c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ab expref: 9 pid: 189433 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.472462:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688e9b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851136:0@lo:104: 00010000:00010000:0.0:1789892529.472463:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892529.472476:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 22 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472534:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892529.472562:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc396450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925842176:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 200us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892529.472571:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 445 00010000:00010000:0.0:1789892529.472632:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 22 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.472643:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852288 00000100:00100000:1.0:1789892529.472649:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852288 00010000:00010000:0.0:1789892529.472650:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e200/0x5c4f93dd00213136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021312f expref: 22 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472668:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 22 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.472669:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892529.472695:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1789892529.472707:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3619:x1876834915851904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.472715:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892529.472716:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915851776:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (1066us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892529.472724:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 22 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.472731:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00010000:00010000:1.0:1789892529.472739:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 22 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472753:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892529.472753:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1789892529.472761:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3619:x1876834915852160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892529.472770:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892529.472774:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 21 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892529.472784:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 21 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.472791:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3619:x1876834915851904:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (623us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892529.472795:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892529.472800:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1789892529.472818:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789892529.472828:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3621:x1876834915852288:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892529.472830:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3619:x1876834915852160:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892529.472838:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00010000:00010000:1.0:1789892529.472852:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892529.472857:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 19 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472869:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 19 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.472883:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892529.472932:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f000/0x5c4f93dd00213128 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213121 expref: 19 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.472945:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915852288:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892529.472952:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851392:0@lo:104: 00010000:00010000:2.0:1789892529.472955:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892529.472965:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00010000:00010000:2.0:1789892529.472970:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.472985:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836e00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892529.472991:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.473000:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f800/0x5c4f93dd0021311a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213113 expref: 17 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.473002:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.473016:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915852160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.473031:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915851904:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892529.473032:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892529.473042:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892529.473074:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892529.473084:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892529.473086:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851520:0@lo:104: 00010000:00010000:2.0:1789892529.473105:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.473114:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915852416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892529.473120:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002130f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002130fe expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.473122:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ec00/0x5c4f93dd0021310c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213105 expref: 16 pid: 189432 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892529.473175:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915851648:0@lo:104: 00010000:00010000:2.0:1789892529.473179:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892529.473186:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892529.473188:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892529.473202:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892529.473216:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876834915852032:0@lo:104: 00000100:00100000:2.0:1789892529.473243:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915852288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.473263:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852416 00000100:00100000:2.0:1789892529.473268:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915851776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.473271:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852416 00010000:00010000:1.0:1789892529.473303:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 16 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.473335:0:213926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.473343:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789892529.473358:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3622:x1876834915852416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892529.473369:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892529.473375:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 16 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473387:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 16 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473401:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fc00/0x5c4f93dd002130fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002130f7 expref: 16 pid: 189434 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473425:0:189426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473436:0:189426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473451:0:189426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473460:0:189426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473470:0:189426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473478:0:189426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473485:0:189426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f200 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:1.0:1789892529.473535:0:189426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473546:0:189426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473568:0:189426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892529.473581:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892529.473601:0:213926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892529.473612:0:213926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892529.473629:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915852416:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (447us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892529.473634:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f200/0x5c4f93dd00213183 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892529.473636:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915852416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892529.473671:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00010000:00010000:1.0:1789892529.954736:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892530.575467:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.575551:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842432 00000100:00100000:3.0:1789892530.575568:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842432 00000100:00100000:3.0:1789892530.575630:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1890 00000100:00100000:3.0:1789892530.575639:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925842432:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892530.575654:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892530.575672:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5b2 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.575696:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.575705:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.575712:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f200, rc 0) 00000100:00100000:3.0:1789892530.575769:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925842432:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 132us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.575774:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1890 00000100:00100000:0.0:1789892530.576736:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.576793:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842560 00000100:00100000:3.0:1789892530.576800:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842560 00000100:00100000:3.0:1789892530.576838:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1891 00000100:00100000:3.0:1789892530.576849:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925842560:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.576979:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925842560:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 132us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.577000:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1891 00000100:00100000:0.0:1789892530.577801:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.577855:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842688 00000100:00100000:3.0:1789892530.577862:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842688 00000100:00100000:3.0:1789892530.577903:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1892 00000100:00100000:3.0:1789892530.577914:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925842688:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.577992:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925842688:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.578001:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1892 00000100:00100000:1.0:1789892530.578991:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.579066:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842816 00000100:00100000:3.0:1789892530.579074:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842816 00000100:00100000:3.0:1789892530.579111:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1893 00000100:00100000:3.0:1789892530.579119:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212891:x1876834925842816:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892530.579235:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212891:x1876834925842816:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.579241:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1893 00000100:00100000:0.0:1789892530.580020:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.580050:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925842944 00000100:00100000:3.0:1789892530.580054:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925842944 00000100:00100000:3.0:1789892530.580076:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1894 00000100:00100000:3.0:1789892530.580080:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212891:x1876834925842944:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892530.580133:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212891:x1876834925842944:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 52us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.580138:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1894 00000100:00100000:0.0:1789892530.581002:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.581032:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843072 00000100:00100000:3.0:1789892530.581036:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843072 00000100:00100000:2.0:1789892530.581098:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1895 00000100:00100000:2.0:1789892530.581110:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925843072:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892530.581121:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892530.581138:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5b9 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.581162:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.581172:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.581179:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe800, rc 0) 00000100:00100000:2.0:1789892530.581206:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925843072:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 101us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.581215:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1895 00000100:00100000:1.0:1789892530.581986:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892530.582015:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843200 00000100:00100000:3.0:1789892530.582020:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843200 00000100:00100000:3.0:1789892530.582047:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1896 00000100:00100000:3.0:1789892530.582052:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925843200:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.582110:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925843200:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 57us (127us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892530.582116:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1896 10000000:01000000:0.0:1789892530.850637:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892530.850649:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 153 10000000:01000000:0.0:1789892530.850658:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892530.850732:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.850749:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.850766:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.850802:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915852544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.850906:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.850970:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.851011:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852544 00000100:00100000:2.0:1789892530.851023:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852544 00000100:00100000:2.0:1789892530.851108:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:2.0:1789892530.851122:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915852544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892530.851142:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892530.851160:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213198 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.851217:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.851231:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.851243:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffe00, rc 0) 00000100:00100000:2.0:1789892530.851300:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915852544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.851309:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:0.0:1789892530.851354:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915852544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892530.851371:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.851381:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.851517:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915852672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.851545:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.851568:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.851610:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852672 00000100:00100000:3.0:1789892530.851617:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852672 00000100:00100000:3.0:1789892530.851659:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:3.0:1789892530.851669:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915852672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.851834:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915852672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.851845:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1789892530.851853:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915852672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.851883:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915852800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.851927:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.851943:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.851969:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852800 00000100:00100000:2.0:1789892530.851975:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852800 00000100:00100000:2.0:1789892530.852006:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1789892530.852014:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915852800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.852113:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915852800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.852121:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1789892530.852140:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915852800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.852536:0:213930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213930:1876834915852928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.852565:0:213930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.852584:0:213930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.852606:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915852928 00000100:00100000:3.0:1789892530.852611:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915852928 00000100:00100000:3.0:1789892530.852634:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:3.0:1789892530.852639:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213930:x1876834915852928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.852717:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213930:x1876834915852928:12345-0@lo:502:llog_process_th.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.852724:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1789892530.852745:0:213930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213930:1876834915852928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.852784:0:213930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213930:1876834915853056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.852811:0:213930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.852827:0:213930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.852854:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853056 00000100:00100000:2.0:1789892530.852858:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853056 00000100:00100000:2.0:1789892530.852881:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:2.0:1789892530.852889:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213930:x1876834915853056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.852949:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:213930:x1876834915853056:12345-0@lo:502:llog_process_th.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.852955:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:0.0:1789892530.852980:0:213930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213930:1876834915853056:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892530.853000:0:213930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:1.0:1789892530.853089:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:1.0:1789892530.853114:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892530.853122:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.853132:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892530.853139:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892530.853140:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789892530.853142:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892530.853157:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.853163:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.853169:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.853179:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.853206:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.853224:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.853262:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853184 00000100:00100000:3.0:1789892530.853268:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853184 00000100:00100000:3.0:1789892530.853303:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1789892530.853311:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915853184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892530.853320:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892530.853337:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131a6 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.853353:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.853364:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.853372:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ec00, rc 0) 00000100:00100000:3.0:1789892530.853409:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915853184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.853418:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1789892530.853441:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892530.853459:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.853466:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.853542:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.853564:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.853583:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.853600:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853312 00000100:00100000:2.0:1789892530.853606:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853312 00000100:00100000:2.0:1789892530.853641:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1789892530.853646:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915853312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.853718:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915853312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.853724:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1789892530.853799:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.853822:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.853855:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.853871:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.853903:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853440 00000100:00100000:3.0:1789892530.853908:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853440 00000100:00100000:3.0:1789892530.853939:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1789892530.853948:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915853440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.854034:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915853440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.854043:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:1.0:1789892530.854061:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892530.854705:0:213931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:0.0:1789892530.854760:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:0.0:1789892530.854784:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892530.854789:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.854806:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892530.854812:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892530.854814:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 153 10000000:01000000:0.0:1789892530.854815:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892530.854828:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.854833:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.854840:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.854849:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.854874:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.854896:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.854947:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853568 00000100:00100000:2.0:1789892530.854953:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853568 00000100:00100000:2.0:1789892530.854980:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:2.0:1789892530.854985:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915853568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892530.854992:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892530.854999:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131b4 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.855013:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.855021:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.855027:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffa00, rc 0) 00000100:00100000:2.0:1789892530.855058:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915853568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.855063:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1789892530.855091:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892530.855106:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.855113:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.855144:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.855165:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.855188:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.855212:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853696 00000100:00100000:3.0:1789892530.855218:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853696 00000100:00100000:3.0:1789892530.855247:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:3.0:1789892530.855254:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915853696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.855326:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915853696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.855335:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:0.0:1789892530.855349:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.855373:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.855404:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.855421:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.855435:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853824 00000100:00100000:2.0:1789892530.855440:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853824 00000100:00100000:2.0:1789892530.855461:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:2.0:1789892530.855465:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915853824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.855574:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915853824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.855586:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:1.0:1789892530.855595:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915853824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.855797:0:213932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213932:1876834915853952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.855826:0:213932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.855845:0:213932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.855870:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915853952 00000100:00100000:3.0:1789892530.855881:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915853952 00000100:00100000:3.0:1789892530.855914:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:3.0:1789892530.855924:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213932:x1876834915853952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.856013:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213932:x1876834915853952:12345-0@lo:502:llog_process_th.0 Request processed in 90us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.856022:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1789892530.856031:0:213932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213932:1876834915853952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.856075:0:213932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213932:1876834915854080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.856110:0:213932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.856125:0:213932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.856158:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854080 00000100:00100000:2.0:1789892530.856162:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854080 00000100:00100000:2.0:1789892530.856186:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1789892530.856191:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213932:x1876834915854080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.856252:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:213932:x1876834915854080:12345-0@lo:502:llog_process_th.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.856258:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1789892530.856263:0:213932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213932:1876834915854080:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892530.856285:0:213932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:1.0:1789892530.856323:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:1.0:1789892530.856343:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892530.856349:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.856357:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892530.856363:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892530.856364:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789892530.856371:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892530.856384:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.856390:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.856395:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.856406:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.856439:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.856460:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.856526:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854208 00000100:00100000:3.0:1789892530.856532:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854208 00000100:00100000:3.0:1789892530.856563:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1789892530.856570:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915854208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892530.856579:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892530.856591:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131c2 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.856608:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.856618:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.856625:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f800, rc 0) 00000100:00100000:3.0:1789892530.856664:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915854208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.856672:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:1.0:1789892530.856683:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892530.856695:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.856701:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.856732:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.856752:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.856774:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.856783:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854336 00000100:00100000:2.0:1789892530.856788:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854336 00000100:00100000:2.0:1789892530.856809:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1789892530.856813:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915854336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.856875:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915854336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.856882:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:1.0:1789892530.856889:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.856911:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.856940:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.856953:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.856981:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854464 00000100:00100000:3.0:1789892530.856987:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854464 00000100:00100000:3.0:1789892530.857018:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1789892530.857029:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915854464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.857123:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915854464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.857132:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1789892530.857140:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892530.857844:0:213933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:0.0:1789892530.857931:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:0.0:1789892530.857946:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789892530.857951:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.857958:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892530.857964:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892530.857966:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 153 10000000:01000000:0.0:1789892530.857967:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892530.857980:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.857992:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.857998:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.858008:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.858033:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.858062:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.858112:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854592 00000100:00100000:2.0:1789892530.858118:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854592 00000100:00100000:2.0:1789892530.858153:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:2.0:1789892530.858163:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915854592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892530.858170:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892530.858178:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131d0 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.858191:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.858198:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.858210:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe200, rc 0) 00000100:00100000:2.0:1789892530.858240:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915854592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.858246:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1789892530.858271:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892530.858282:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.858288:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.858319:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.858340:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.858355:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.858368:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854720 00000100:00100000:3.0:1789892530.858372:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854720 00000100:00100000:3.0:1789892530.858396:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1789892530.858401:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915854720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.858475:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915854720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.858515:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1789892530.858610:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.858631:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.858659:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.858684:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.858686:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854848 00000100:00100000:2.0:1789892530.858691:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854848 00000100:00100000:2.0:1789892530.858714:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1789892530.858720:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915854848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.858780:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915854848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.858786:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1789892530.858795:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915854848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.858996:0:213934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213934:1876834915854976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.859026:0:213934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.859041:0:213934:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.859055:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915854976 00000100:00100000:3.0:1789892530.859059:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915854976 00000100:00100000:3.0:1789892530.859081:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1789892530.859085:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213934:x1876834915854976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.859145:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213934:x1876834915854976:12345-0@lo:502:llog_process_th.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.859151:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1789892530.859163:0:213934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213934:1876834915854976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.859196:0:213934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213934:1876834915855104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.859222:0:213934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.859236:0:213934:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.859248:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855104 00000100:00100000:2.0:1789892530.859252:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855104 00000100:00100000:2.0:1789892530.859280:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1789892530.859285:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213934:x1876834915855104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.859345:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:213934:x1876834915855104:12345-0@lo:502:llog_process_th.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.859350:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:0.0:1789892530.859372:0:213934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213934:1876834915855104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892530.859391:0:213934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:1.0:1789892530.859438:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:1.0:1789892530.859461:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892530.859468:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.859512:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892530.859521:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892530.859523:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 175 10000000:01000000:1.0:1789892530.859525:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892530.859539:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.859544:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.859550:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.859559:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.859583:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.859605:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.859616:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855232 00000100:00100000:3.0:1789892530.859622:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855232 00000100:00100000:3.0:1789892530.859651:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1789892530.859659:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915855232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892530.859668:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892530.859676:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131de expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.859689:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131de expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.859701:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131de expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.859707:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f000, rc 0) 00000100:00100000:3.0:1789892530.859736:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915855232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.859741:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1789892530.859763:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892530.859774:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.859790:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.859820:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.859841:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.859855:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.859864:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855360 00000100:00100000:2.0:1789892530.859869:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855360 00000100:00100000:2.0:1789892530.859890:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1789892530.859896:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915855360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.859955:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915855360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.859960:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1789892530.859981:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.860003:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.860031:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.860045:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.860054:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855488 00000100:00100000:3.0:1789892530.860058:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855488 00000100:00100000:3.0:1789892530.860077:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:3.0:1789892530.860083:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915855488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.860143:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915855488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.860149:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1789892530.860156:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.860339:0:213935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213935:1876834915855616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892530.860365:0:213935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.860378:0:213935:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.860388:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855616 00000100:00100000:2.0:1789892530.860393:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855616 00000100:00100000:2.0:1789892530.860415:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1789892530.860419:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213935:x1876834915855616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.860526:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213935:x1876834915855616:12345-0@lo:502:llog_process_th.0 Request processed in 105us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.860533:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1789892530.860543:0:213935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213935:1876834915855616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892530.860567:0:213935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892530.860577:0:213935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892530.860579:0:213935:0:(obd_config.c:1561:class_process_config()) marker 165 (0x1) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:1.0:1789892530.860584:0:213935:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789892530.860603:0:213935:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:1.0:1789892530.860617:0:213935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213935:1876834915855744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892530.860643:0:213935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.860661:0:213935:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e7d5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.860688:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855744 00000100:00100000:3.0:1789892530.860694:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855744 00000100:00100000:3.0:1789892530.860727:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1789892530.860737:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213935:x1876834915855744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.860822:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:213935:x1876834915855744:12345-0@lo:502:llog_process_th.0 Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892530.860829:0:213935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213935:1876834915855744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.860832:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000020:01000000:1.0:1789892530.860857:0:213935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892530.860862:0:213935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892530.860863:0:213935:0:(obd_config.c:1561:class_process_config()) marker 165 (0x2) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892530.860867:0:213935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 178 count 175 00000020:01000000:0.0:1789892530.860917:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 175-177 (rc=0) 10000000:01000000:0.0:1789892530.860935:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892530.860940:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.860947:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892530.860953:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892530.860954:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 153 10000000:01000000:0.0:1789892530.860956:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892530.860969:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.860973:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.860979:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.860997:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.861021:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.861038:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.861054:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915855872 00000100:00100000:2.0:1789892530.861058:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915855872 00000100:00100000:2.0:1789892530.861079:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1789892530.861083:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915855872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892530.861089:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892530.861099:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131ec expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.861117:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.861127:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892530.861136:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892530.861168:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915855872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.861173:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1789892530.861197:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915855872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892530.861208:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.861214:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.861242:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.861263:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.861278:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.861302:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856000 00000100:00100000:3.0:1789892530.861308:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856000 00000100:00100000:3.0:1789892530.861337:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1789892530.861346:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915856000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.861430:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915856000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.861440:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1789892530.861448:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.861509:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.861542:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.861564:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892530.861568:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856128 00000100:00100000:2.0:1789892530.861572:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856128 00000100:00100000:2.0:1789892530.861595:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:2.0:1789892530.861603:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915856128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.861669:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915856128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.861682:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1789892530.861683:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892530.861892:0:213936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213936:1876834915856256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.861928:0:213936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892530.861947:0:213936:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688585d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.861957:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856256 00000100:00100000:3.0:1789892530.861962:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856256 00000100:00100000:3.0:1789892530.861987:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1789892530.861994:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213936:x1876834915856256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.862063:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213936:x1876834915856256:12345-0@lo:502:llog_process_th.0 Request processed in 69us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.862070:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1789892530.862075:0:213936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213936:1876834915856256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.862124:0:213936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213936:1876834915856384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892530.862165:0:213936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892530.862183:0:213936:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688493b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.862188:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856384 00000100:00100000:3.0:1789892530.862193:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856384 00000100:00100000:3.0:1789892530.862217:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1789892530.862226:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213936:x1876834915856384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.862289:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:213936:x1876834915856384:12345-0@lo:502:llog_process_th.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.862296:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1789892530.862304:0:213936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213936:1876834915856384:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892530.862326:0:213936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:0.0:1789892530.862393:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:0.0:1789892530.862417:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892530.862423:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.862433:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892530.862448:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892530.862451:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 175 10000000:01000000:0.0:1789892530.862453:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892530.862472:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.862478:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.862520:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.862532:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.862560:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.862591:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.862601:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856512 00000100:00100000:3.0:1789892530.862606:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856512 00000100:00100000:3.0:1789892530.862632:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1789892530.862639:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915856512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892530.862645:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892530.862653:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002131fa expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.862667:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.862680:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.862687:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e600, rc 0) 00000100:00100000:3.0:1789892530.862723:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915856512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.862729:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:0.0:1789892530.862752:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892530.862763:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892530.862769:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892530.862794:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.862812:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.862826:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.862835:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856640 00000100:00100000:3.0:1789892530.862839:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856640 00000100:00100000:3.0:1789892530.862858:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1789892530.862862:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915856640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.862917:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915856640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.862922:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1789892530.862931:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.862959:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.862986:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.862999:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.863008:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856768 00000100:00100000:3.0:1789892530.863012:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856768 00000100:00100000:3.0:1789892530.863030:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1789892530.863035:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915856768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.863091:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915856768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.863097:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:0.0:1789892530.863114:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915856768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892530.863310:0:213937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213937:1876834915856896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892530.863337:0:213937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.863350:0:213937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.863370:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915856896 00000100:00100000:3.0:1789892530.863376:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915856896 00000100:00100000:3.0:1789892530.863404:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1789892530.863413:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213937:x1876834915856896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.863575:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213937:x1876834915856896:12345-0@lo:502:llog_process_th.0 Request processed in 161us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.863584:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:1.0:1789892530.863592:0:213937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213937:1876834915856896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892530.863613:0:213937:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892530.863618:0:213937:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892530.863620:0:213937:0:(obd_config.c:1561:class_process_config()) marker 164 (0x1) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:1.0:1789892530.863624:0:213937:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789892530.863632:0:213937:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:0.0:1789892530.863949:0:213937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213937:1876834915857024:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789892530.863964:0:213938:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892530.863969:0:213938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:0.0:1789892530.863980:0:213937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892530.864009:0:213937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.864017:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857024 00000100:00100000:3.0:1789892530.864023:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857024 00000100:00100000:3.0:1789892530.864057:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1789892530.864065:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213937:x1876834915857024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892530.864141:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:213937:x1876834915857024:12345-0@lo:502:llog_process_th.0 Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892530.864150:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:0.0:1789892530.864164:0:213937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5407480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:213937:1876834915857024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892530.864184:0:213937:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892530.864189:0:213937:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892530.864190:0:213937:0:(obd_config.c:1561:class_process_config()) marker 164 (0x2) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789892530.864194:0:213937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 178 count 175 00000020:01000000:1.0:1789892530.864252:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 175-177 (rc=0) 10000000:01000000:1.0:1789892530.864269:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892530.864276:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.864286:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892530.864294:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892530.864297:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:1.0:1789892530.864299:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892530.864315:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.864321:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.864327:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.864342:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915857152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.864364:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.864378:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e7d59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.864397:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857152 00000100:00100000:3.0:1789892530.864402:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857152 00000100:00100000:3.0:1789892530.864435:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1789892530.864442:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915857152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892530.864450:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892530.864459:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213208 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.864475:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.864535:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892530.864544:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f600, rc 0) 00000100:00100000:3.0:1789892530.864586:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915857152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892530.864592:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915857152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892530.864601:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892530.864608:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00010000:00010000:1.0:1789892530.864613:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892530.864647:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915857280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892530.864666:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892530.864685:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e7d59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892530.864696:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857280 00000100:00100000:3.0:1789892530.864701:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857280 00000100:00100000:3.0:1789892530.864728:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1789892530.864735:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915857280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.864792:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915857280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (124us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892530.864800:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915857280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892530.864803:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 10000000:01000000:1.0:1789892530.864824:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892530.864830:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892530.864836:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892530.978714:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789892530.978742:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915857408:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892530.978747:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892530.978827:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892530.978877:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857408 00000100:00100000:2.0:1789892530.978887:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857408 00000100:00100000:2.0:1789892530.978942:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789892530.978951:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915857408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892530.978996:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892530.979046:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915857408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892530.979052:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789892530.979095:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789892531.490663:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789892531.490690:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915857536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892531.490777:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892531.490826:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857536 00000100:00100000:0.0:1789892531.490837:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857536 00000100:00100000:0.0:1789892531.490915:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789892531.490930:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915857536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789892531.490981:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:0.0:1789892531.491059:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915857536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892531.491070:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789892531.491096:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915857536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892532.002660:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915857664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892532.002764:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915857920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892532.002765:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892532.002843:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915858176:0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.002872:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892532.002920:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.002936:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857664 00000100:00100000:1.0:1789892532.002944:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915858432:0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.002949:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857664 00000100:00100000:2.0:1789892532.002986:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915858688:0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.003011:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.003029:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857920 00000100:00100000:3.0:1789892532.003036:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857920 00000100:00100000:2.0:1789892532.003045:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892532.003054:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915858944:0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.003082:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789892532.003093:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915857792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892532.003098:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915857664:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892532.003099:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915859200:0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.003116:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789892532.003152:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892532.003165:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915859456:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003170:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.003182:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.003220:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915858304:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003227:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858432 00000100:00100000:2.0:1789892532.003232:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858432 00000100:00100000:3.0:1789892532.003259:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915857664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892532.003268:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892532.003271:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858944 00000100:00100000:0.0:1789892532.003274:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892532.003279:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858944 00000100:00100000:3.0:1789892532.003285:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789892532.003314:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915857792 00000100:00100000:3.0:1789892532.003318:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915857792 00000100:00100000:2.0:1789892532.003320:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789892532.003332:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915858432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.003360:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789892532.003362:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789892532.003382:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915857920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892532.003385:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915858048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892532.003392:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915858432:12345-0@lo:400:kworker.0 Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892532.003415:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00002000:00000024:3.0:1789892532.003429:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892532.003441:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915858816:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003442:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789892532.003472:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1876834915858944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.003485:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.003521:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.003528:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915857920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.003537:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789892532.003560:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858048 00000100:00100000:3.0:1789892532.003565:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858048 00000100:00100000:0.0:1789892532.003571:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1876834915859328:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003573:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1876834915858944:12345-0@lo:400:kworker.0 Request processed in 116us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892532.003574:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915858560:0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.003587:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789892532.003605:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789892532.003610:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.003611:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1876834915857792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789892532.003625:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892532.003643:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858688 00000100:00100000:2.0:1789892532.003648:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858688 00010000:00010000:0.0:1789892532.003661:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892532.003668:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.003677:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915857792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (505us total) trans 0 rc 0/0 00000100:00080000:0.0:1789892532.003680:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892532.003686:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:0.0:1789892532.003688:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892532.003692:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859200 00000100:00100000:2.0:1789892532.003696:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859200 00000100:00100000:0.0:1789892532.003714:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859456 00000100:00100000:3.0:1789892532.003719:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789892532.003721:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859456 00000100:00100000:3.0:1789892532.003734:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915858048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892532.003734:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915859072:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003737:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859328 00000100:00100000:2.0:1789892532.003741:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859328 00002000:00000024:3.0:1789892532.003754:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892532.003759:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1789892532.003780:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1789892532.003780:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915858688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003793:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915859200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.003799:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915858048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.003811:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789892532.003818:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.003846:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915858688:12345-0@lo:400:kworker.0 Request processed in 74us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.003850:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858176 00000100:00100000:0.0:1789892532.003854:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1789892532.003855:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858176 00000100:00100000:2.0:1789892532.003860:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915859200:12345-0@lo:400:kworker.0 Request processed in 69us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892532.003868:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915859584:0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.003874:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859072 00000100:00100000:0.0:1789892532.003881:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859072 00000100:00100000:2.0:1789892532.003892:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1789892532.003902:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1789892532.003918:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915858176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.003920:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1789892532.003931:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789892532.003936:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915859456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.003949:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876834915859328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.003960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.003968:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915858176:12345-0@lo:400:kworker.0 Request processed in 56us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.003977:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:0.0:1789892532.004021:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915859456:12345-0@lo:400:kworker.0 Request processed in 90us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892532.004023:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876834915859328:12345-0@lo:400:kworker.0 Request processed in 82us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892532.004034:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789892532.004037:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915858432:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.004041:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789892532.004048:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859584 00000100:00100000:0.0:1789892532.004055:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892532.004061:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859584 00000100:00100000:0.0:1789892532.004070:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915859072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.004078:0:190942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858560 00000100:00100000:2.0:1789892532.004087:0:190942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858560 00000100:00100000:1.0:1789892532.004087:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915858944:0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.004111:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789892532.004127:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915859584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.004139:0:190942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789892532.004139:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915859456:0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.004141:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915859072:12345-0@lo:400:kworker.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892532.004160:0:190942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915858560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.004174:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892532.004181:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915859584:12345-0@lo:400:kworker.0 Request processed in 57us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.004193:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1789892532.004221:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915857920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892532.004222:0:190942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915858560:12345-0@lo:400:kworker.0 Request processed in 62us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892532.004224:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858304 00000100:00100000:0.0:1789892532.004234:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858304 00000100:00100000:2.0:1789892532.004243:0:190942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789892532.004251:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915859200:0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.004273:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915858176:0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.004297:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915858816 00000100:00080000:2.0:1789892532.004298:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892532.004302:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915858688:0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.004305:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915858816 00000100:00080000:2.0:1789892532.004307:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892532.004326:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915857664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892532.004340:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789892532.004350:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915858048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892532.004352:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915858304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.004363:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789892532.004380:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915858816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892532.004413:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915858560:0@lo:400:kworker.0 00000100:00100000:0.0:1789892532.004415:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915858304:12345-0@lo:400:kworker.0 Request processed in 58us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.004430:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915857792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892532.004431:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915858816:12345-0@lo:400:kworker.0 Request processed in 54us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892532.004440:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789892532.004450:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915859072:0@lo:400:kworker.0 00000100:00100000:2.0:1789892532.004452:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789892532.004480:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915858304:0@lo:400:kworker.0 00000100:00100000:3.0:1789892532.004520:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915858816:0@lo:400:kworker.0 00010000:00080000:3.0:1789892532.004542:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688b20fb80 x1876834915859328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892532.004555:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1876834915859328:0@lo:400:kworker.0 00010000:00080000:1.0:1789892532.004565:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688b20ca80 x1876834915859584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892532.004585:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915859584:0@lo:400:kworker.0 00000020:00000080:1.0:1789892532.066760:0:214036:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffceca16bd0 20000000:00000080:1.0:1789892532.066778:0:214036:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90688b356800 uarg=0000000000000000 00000040:00100000:1.0:1789892532.067308:0:214036:0:(llog.c:1072:llog_reverse_process()) index 155 : idx 137 20000000:01000000:1.0:1789892532.067313:0:214036:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 154 cmd:0xce022 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:1.0:1789892532.067338:0:214036:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789892532.067724:0:214037:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 138 marker 148 1->4: lustre-clilov new lustre.qpool2 20000000:01000000:1.0:1789892532.067776:0:214037:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 140 marker 148 2->4: lustre-clilov new lustre.qpool2 00000040:00080000:1.0:1789892532.067788:0:214037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000040:00080000:3.0:1789892532.067968:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].156, 224 off36624 20000000:01000000:3.0:1789892532.067989:0:214036:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:3.0:1789892532.068001:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].157, 104 off36728 00000040:00080000:3.0:1789892532.068019:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].158, 224 off36952 20000000:01000000:3.0:1789892532.068031:0:214036:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789892532.068293:0:214038:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 160 marker 149 1->4: lustre-MDT0000-mdtlov new lustre.qpool2 20000000:01000000:1.0:1789892532.068314:0:214038:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 149 2->4: lustre-MDT0000-mdtlov new lustre.qpool2 00000040:00080000:1.0:1789892532.068325:0:214038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 178 count 175 00000040:00080000:3.0:1789892532.068435:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].178, 224 off40800 20000000:01000000:3.0:1789892532.068448:0:214036:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:3.0:1789892532.068851:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].179, 112 off40912 00000040:00080000:3.0:1789892532.068901:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].181, 224 off41184 20000000:01000000:3.0:1789892532.068922:0:214036:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789892532.069154:0:214039:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 160 marker 150 1->4: lustre-MDT0001-mdtlov new lustre.qpool2 20000000:01000000:1.0:1789892532.069174:0:214039:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 150 2->4: lustre-MDT0001-mdtlov new lustre.qpool2 00000040:00080000:1.0:1789892532.069184:0:214039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 178 count 175 00000040:00080000:3.0:1789892532.069270:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].178, 224 off40800 20000000:01000000:3.0:1789892532.069284:0:214036:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:3.0:1789892532.069303:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].179, 112 off40912 00000040:00080000:3.0:1789892532.069321:0:214036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].181, 224 off41184 10000000:01000000:3.0:1789892532.069331:0:214036:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789892532.069352:0:214036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069373:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069380:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069387:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069392:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069396:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069401:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069405:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069420:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131de expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069425:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069429:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069434:0:214036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069439:0:214036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069529:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069543:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 23 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.069558:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915859712:0@lo:104: 00000100:00100000:3.0:1789892532.069631:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892532.069678:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859712 00010000:00010000:3.0:1789892532.069690:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.069691:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859712 00010000:00010000:3.0:1789892532.069704:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 23 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.069723:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915859840:0@lo:104: 00000100:00100000:3.0:1789892532.069744:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892532.069752:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789892532.069763:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214036:x1876834915859712:12345-0@lo:104: 00000100:00100000:0.0:1789892532.069778:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859840 00010000:00010000:1.0:1789892532.069780:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.069790:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.069790:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859840 00010000:00010000:3.0:1789892532.069813:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 23 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.069827:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915859968:0@lo:104: 00000100:00100000:0.0:1789892532.069846:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1789892532.069860:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915859840:12345-0@lo:104: 00010000:00010000:0.0:1789892532.069874:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.069884:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892532.069905:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892532.069915:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915859712:12345-0@lo:104: Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892532.069928:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:3.0:1789892532.069933:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131de expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.069949:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892532.069950:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131de expref: 23 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.069954:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892532.069957:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915859968 00000100:00100000:0.0:1789892532.069964:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214036:x1876834915859840:12345-0@lo:104: Request processed in 103us (211us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892532.069969:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.069969:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915859968 00000100:00100000:3.0:1789892532.069975:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860096:0@lo:104: 00000100:00100000:0.0:1789892532.069980:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:2.0:1789892532.069990:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801400 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892532.069997:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070018:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070019:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1789892532.070027:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789892532.070032:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070034:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214036:x1876834915859968:12345-0@lo:104: 10000000:01000000:2.0:1789892532.070048:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892532.070051:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.070059:0:189472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789892532.070074:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.070080:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860096 00000100:00100000:1.0:1789892532.070087:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860096 00010000:00010000:2.0:1789892532.070089:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.070094:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 23 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070099:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892532.070108:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860224:0@lo:104: 00000100:00100000:1.0:1789892532.070124:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00010000:00010000:0.0:1789892532.070124:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892532.070134:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.070134:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688487e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915860096:12345-0@lo:104: 00000100:00100000:0.0:1789892532.070145:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915859968:12345-0@lo:104: Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.070156:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892532.070158:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070168:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801400/0x5c4f93dd00213208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021320f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070177:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00010000:2.0:1789892532.070197:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892532.070198:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070203:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070211:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860224 00010000:00010000:2.0:1789892532.070212:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892532.070218:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070219:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860224 00010000:00010000:1.0:1789892532.070220:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892532.070225:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 23 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.070241:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688487e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915860096:12345-0@lo:104: Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892532.070244:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789892532.070269:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915860224:12345-0@lo:104: 00010000:00010000:2.0:1789892532.070277:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.070283:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860480:0@lo:104: 00000100:00100000:1.0:1789892532.070283:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00010000:00010000:0.0:1789892532.070283:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892532.070307:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892532.070323:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892532.070340:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892532.070348:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892532.070349:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.070355:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070370:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892532.070374:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892532.070375:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837000 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892532.070380:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070383:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892532.070386:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070399:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214036:x1876834915860224:12345-0@lo:104: Request processed in 129us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892532.070422:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 23 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070422:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002131fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213201 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.070436:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070441:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:2.0:1789892532.070447:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892532.070448:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860736:0@lo:104: 00010000:00010000:2.0:1789892532.070472:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070478:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860480 10000000:00010000:1.0:1789892532.070483:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070484:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860480 00010000:00010000:2.0:1789892532.070549:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892532.070555:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070568:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.070575:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789892532.070579:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892532.070586:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892532.070596:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860736 00000100:00100000:0.0:1789892532.070602:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860736 00010000:00010000:2.0:1789892532.070612:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892532.070614:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892532.070631:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892532.070634:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00010000:00010000:3.0:1789892532.070635:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.070649:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 23 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070650:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915860480:12345-0@lo:104: 00010000:00010000:1.0:1789892532.070656:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070664:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.070672:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.070683:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860992:0@lo:104: 00010000:00010000:2.0:1789892532.070701:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd002131de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131e5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.070707:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892532.070722:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892532.070727:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892532.070731:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.070734:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070749:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836e00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892532.070751:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.070753:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789892532.070756:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.070768:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd002131ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131f3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070777:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915860480:12345-0@lo:104: Request processed in 125us (431us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892532.070778:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.070780:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 23 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892532.070816:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.070821:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915861248:0@lo:104: 00010000:00010000:1.0:1789892532.070823:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892532.070835:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070836:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 10000000:01000000:2.0:1789892532.070841:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892532.070865:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800a00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892532.070867:0:214036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.070867:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860992 00010000:00010000:2.0:1789892532.070879:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892532.070880:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070881:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860992 00010000:00010000:3.0:1789892532.070905:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070906:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915861248 00010000:00010000:1.0:1789892532.070916:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070917:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892532.070918:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915861248 00010000:00010000:3.0:1789892532.070929:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 9 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.070933:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892532.070949:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070950:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00010000:00010000:2.0:1789892532.070971:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002131d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131d7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.070978:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214036:x1876834915860736:12345-0@lo:104: 00000100:00100000:3.0:1789892532.070980:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915861504:192.168.204.33@tcp:104: 10000000:01000000:1.0:1789892532.070995:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892532.071005:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.071028:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.071037:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892532.071038:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892532.071045:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892532.071052:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.071053:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892532.071061:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800a00/0x5c4f93dd002131c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131c9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.071082:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892532.071082:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1789892532.071083:0:214036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892532.071086:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00010000:00010000:1.0:1789892532.071099:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.071113:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214036:x1876834915860736:12345-0@lo:104: Request processed in 134us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892532.071115:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214036:x1876834915860992:12345-0@lo:104: 00010000:00010000:3.0:1789892532.071118:0:214036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.071143:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836600 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:2.0:1789892532.071148:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892532.071153:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.071155:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1789892532.071175:0:214036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915861760:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892532.071189:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00010000:00010000:1.0:1789892532.071203:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.071214:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915861248:12345-0@lo:104: 10000000:00010000:1.0:1789892532.071218:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071226:0:214036:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e401900 going to sleep for 11 seconds 10000000:01000000:1.0:1789892532.071231:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892532.071233:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.071240:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892532.071251:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214036:x1876834915860992:12345-0@lo:104: Request processed in 146us (532us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892532.071260:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892532.071261:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1789892532.071265:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915859712:0@lo:104: 00010000:00010000:1.0:1789892532.071285:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892532.071291:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892532.071293:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.071301:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892532.071304:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915859840:0@lo:104: 00000100:00100000:0.0:1789892532.071313:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214036:x1876834915861248:12345-0@lo:104: Request processed in 99us (441us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892532.071316:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071339:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915859968:0@lo:104: 00000100:00100000:0.0:1789892532.071349:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:2.0:1789892532.071353:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801c00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892532.071363:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860096:0@lo:104: 10000000:00010000:2.0:1789892532.071365:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.071376:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd002131b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131bb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.071383:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892532.071384:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071386:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860224:0@lo:104: 00010000:00010000:1.0:1789892532.071390:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892532.071393:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.071399:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789892532.071400:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071406:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860480:0@lo:104: 00010000:00010000:1.0:1789892532.071406:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892532.071411:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837c00 already unused, calling callback (ffffffffc112ec20) 10000000:01000000:2.0:1789892532.071417:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892532.071426:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892532.071428:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860736:0@lo:104: 10000000:00010000:0.0:1789892532.071428:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.071443:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915860864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892532.071445:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071449:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915860992:0@lo:104: 00010000:00010000:2.0:1789892532.071449:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892532.071483:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071484:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915861248:0@lo:104: 00010000:00010000:2.0:1789892532.071486:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892532.071532:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.071540:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd002131a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002131ad expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.071555:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789892532.071561:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892532.071586:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892532.071591:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892532.071600:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892532.071602:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.071613:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892532.071621:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860864 00000100:00100000:2.0:1789892532.071622:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915860352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892532.071628:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.071629:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915861888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.071638:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860864 00010000:00010000:0.0:1789892532.071652:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021319f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892532.071673:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892532.071673:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892532.071679:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892532.071681:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131de expref: 24 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.071685:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892532.071701:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892532.071711:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915861376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.071726:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860352 00000100:00100000:3.0:1789892532.071731:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860352 00010000:00010000:3.0:1789892532.071751:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 25 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.071760:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789892532.071768:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892532.071773:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915861120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.071782:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915861888 00000100:00100000:3.0:1789892532.071788:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915861888 00000100:00100000:2.0:1789892532.071808:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915862144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892532.071816:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 26 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.071824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892532.071860:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915861376 00000100:00100000:3.0:1789892532.071864:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915861376 00000100:00100000:2.0:1789892532.071864:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.071868:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915861120 00000100:00100000:1.0:1789892532.071870:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915862016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892532.071875:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915861120 00010000:00010000:3.0:1789892532.071883:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 28 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892532.071889:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789892532.071900:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915860608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892532.071904:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 28 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.071915:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892532.071951:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.071959:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862144 00000100:00100000:0.0:1789892532.071965:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862144 00000100:00100000:1.0:1789892532.071976:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862016 00000100:00100000:1.0:1789892532.071983:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862016 00010000:00010000:0.0:1789892532.071985:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 29 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.071987:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915860608 00000100:00100000:2.0:1789892532.071988:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915861632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.071995:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915860608 00010000:00010000:1.0:1789892532.072007:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 31 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072020:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 31 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892532.072037:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892532.072040:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789892532.072060:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915860864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892532.072073:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892532.072080:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131de expref: 31 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.072089:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915861632 00010000:00010000:0.0:1789892532.072095:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131de expref: 31 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892532.072098:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915861632 00000100:00100000:1.0:1789892532.072106:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00010000:00010000:0.0:1789892532.072119:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f000/0x5c4f93dd002131e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131de expref: 32 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072120:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 32 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.072125:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc397850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+32:3621:x1876834915860352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892532.072132:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00010000:00010000:1.0:1789892532.072155:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892532.072157:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915861888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892532.072161:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892532.072167:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00010000:00010000:1.0:1789892532.072170:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 31 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.072178:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892532.072183:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3621:x1876834915861376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892532.072188:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 31 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.072205:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915860864:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (654us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892532.072229:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 31 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.072239:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00010000:00010000:2.0:1789892532.072262:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 30 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892532.072267:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1789892532.072277:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3619:x1876834915861120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892532.072286:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892532.072291:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 30 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.072296:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f600/0x5c4f93dd0021320f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213208 expref: 30 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.072305:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffa00/0x5c4f93dd002131bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131b4 expref: 30 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072314:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892532.072325:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 30 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072336:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 30 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.072362:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892532.072363:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892532.072373:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd002131f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131ec expref: 28 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072378:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 28 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072400:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe200/0x5c4f93dd002131d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131d0 expref: 27 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.072403:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892532.072421:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892532.072440:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc397850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3621:x1876834915860352:12345-0@lo:103:ldlm_bl.0 Request processed in 324us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892532.072450:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915861888:12345-0@lo:103:ldlm_bl.0 Request processed in 294us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892532.072476:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789892532.072487:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789892532.072515:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915861120:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892532.072538:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789892532.072545:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3621:x1876834915861376:12345-0@lo:103:ldlm_bl.0 Request processed in 309us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.072558:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1789892532.072579:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789892532.072589:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789892532.072594:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915862144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.072599:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00010000:00010000:2.0:1789892532.072607:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892532.072611:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789892532.072612:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3619:x1876834915862016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.072616:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915860608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892532.072619:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 22 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.072633:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc394450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915861632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892532.072638:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892532.072642:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892532.072658:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 22 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.072660:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 22 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.072665:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 22 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.072667:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892532.072690:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 22 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072697:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 22 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.072780:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 22 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.072796:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021319f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213198 expref: 22 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.072798:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 22 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072844:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e600/0x5c4f93dd00213201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131fa expref: 21 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.072851:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ec00/0x5c4f93dd002131ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131a6 expref: 21 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892532.072854:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892532.072858:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f800/0x5c4f93dd002131c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002131c2 expref: 21 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.072862:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892532.072890:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915862144:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (1028us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892532.072895:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892532.072899:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892532.072900:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915860608:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892532.072905:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1789892532.072910:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1789892532.072951:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc394450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915861632:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892532.072960:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789892532.072972:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3619:x1876834915862016:12345-0@lo:103:ldlm_bl.0 Request processed in 366us (1056us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892532.072974:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892532.072985:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789892532.073056:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915860608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892532.073081:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915861632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892532.073091:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915862144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892532.073100:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915860352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892532.073108:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915861376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892532.073176:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915861120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892532.073214:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915861504:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892532.073216:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915862016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892532.073216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892532.073256:0:214036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214036:1876834915861760:192.168.204.33@tcp:104: 00000100:00100000:3.0:1789892532.073258:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843328 00000100:00100000:2.0:1789892532.073261:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915860864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892532.073270:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843328 00000100:00100000:1.0:1789892532.073279:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892532.073286:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915861888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892532.073301:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 10 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.073353:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843456 00000100:00100000:1.0:1789892532.073359:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843456 00000100:00100000:3.0:1789892532.073364:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 460 00000100:00100000:3.0:1789892532.073385:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925843328:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892532.073388:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 11 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.073391:0:214036:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.073404:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892532.073421:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 11 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.073443:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 11 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.073450:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 461 00000100:00100000:1.0:1789892532.073478:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925843456:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892532.073540:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b9 expref: 11 pid: 189433 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892532.073559:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892532.073607:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925843328:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 233us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892532.073623:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 460 00010000:00010000:1.0:1789892532.073644:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892532.073652:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073662:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073681:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f200/0x5c4f93dd0021318a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5b2 expref: 9 pid: 189432 timeout: 3457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073696:0:189424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073706:0:189424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073723:0:189424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073730:0:189424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073738:0:189424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073757:0:189424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073765:0:189424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e800 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:1.0:1789892532.073769:0:189424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073776:0:189424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073790:0:189424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892532.073799:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892532.073815:0:214036:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892532.073836:0:214036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.073846:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2400:x1876834925843456:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 367us (570us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892532.073846:0:214036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e800/0x5c4f93dd00213216 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892532.073889:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 461 00010000:00010000:1.0:1789892533.026733:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892533.967551:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892533.967618:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843584 00000100:00100000:3.0:1789892533.967634:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843584 00000100:00100000:3.0:1789892533.967703:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1936 00000100:00100000:3.0:1789892533.967713:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925843584:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892533.967734:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892533.967755:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5c0 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892533.967789:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892533.967822:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892533.967835:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e600, rc 0) 00000100:00100000:3.0:1789892533.967914:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925843584:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 201us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892533.967922:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1936 00000100:00100000:2.0:1789892533.968984:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892533.969040:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843712 00000100:00100000:0.0:1789892533.969046:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843712 00000100:00100000:0.0:1789892533.969085:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1937 00000100:00100000:0.0:1789892533.969095:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925843712:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892533.969235:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925843712:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 142us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892533.969241:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1937 00000100:00100000:0.0:1789892533.969979:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892533.970014:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843840 00000100:00100000:3.0:1789892533.970018:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843840 00000100:00100000:3.0:1789892533.970043:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1938 00000100:00100000:3.0:1789892533.970049:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925843840:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892533.970131:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925843840:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892533.970137:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1938 00000100:00100000:1.0:1789892533.971334:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892533.971380:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925843968 00000100:00100000:0.0:1789892533.971386:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925843968 00000100:00100000:0.0:1789892533.971412:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1939 00000100:00100000:0.0:1789892533.971433:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212910:x1876834925843968:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892533.971557:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212910:x1876834925843968:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 138us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892533.971563:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1939 00000100:00100000:2.0:1789892533.972197:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892533.972233:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844096 00000100:00100000:3.0:1789892533.972243:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844096 00000100:00100000:3.0:1789892533.972288:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1940 00000100:00100000:3.0:1789892533.972300:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212910:x1876834925844096:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892533.972447:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:212910:x1876834925844096:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 149us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892533.972457:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1940 00000100:00100000:2.0:1789892533.973358:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892533.973403:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844224 00000100:00100000:0.0:1789892533.973410:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844224 00000100:00100000:0.0:1789892533.973464:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1941 00000100:00100000:0.0:1789892533.973474:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925844224:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892533.973516:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892533.973534:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5c7 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892533.973559:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892533.973571:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892533.973580:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837400, rc 0) 00000100:00100000:0.0:1789892533.973615:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925844224:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 142us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892533.973622:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1941 00000100:00100000:1.0:1789892533.974303:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892533.974346:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844352 00000100:00100000:3.0:1789892533.974353:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844352 00000100:00100000:3.0:1789892533.974387:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1942 00000100:00100000:3.0:1789892533.974396:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925844352:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892533.974522:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925844352:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 126us (217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892533.974531:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1942 00010000:00010000:1.0:1789892534.050651:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789892534.114579:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892534.114592:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 156 10000000:01000000:0.0:1789892534.114601:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892534.114674:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.114690:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.114706:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892534.114742:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.114847:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.114929:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862272 00000100:00100000:0.0:1789892534.114929:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.114947:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862272 00000100:00100000:2.0:1789892534.115020:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1789892534.115033:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915862272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.115051:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892534.115070:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021322b expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.115101:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.115113:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.115136:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff600, rc 0) 00000100:00100000:2.0:1789892534.115215:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915862272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.115225:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:0.0:1789892534.115268:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892534.115293:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.115306:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892534.115396:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.115452:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.115478:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.115520:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862400 00000100:00100000:3.0:1789892534.115528:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862400 00000100:00100000:3.0:1789892534.115567:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1789892534.115576:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915862400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.115718:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915862400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.115725:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:0.0:1789892534.115742:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.115778:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.115826:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.115850:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.115877:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862528 00000100:00100000:2.0:1789892534.115883:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862528 00000100:00100000:2.0:1789892534.115909:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1789892534.115918:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915862528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.116017:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915862528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.116026:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1789892534.116043:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.116390:0:214040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214040:1876834915862656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.116449:0:214040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.116469:0:214040:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.116509:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862656 00000100:00100000:3.0:1789892534.116514:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862656 00000100:00100000:3.0:1789892534.116537:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:3.0:1789892534.116544:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:214040:x1876834915862656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.116643:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:214040:x1876834915862656:12345-0@lo:502:llog_process_th.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.116649:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:0.0:1789892534.116654:0:214040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214040:1876834915862656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.116696:0:214040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214040:1876834915862784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.116722:0:214040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.116740:0:214040:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.116770:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862784 00000100:00100000:2.0:1789892534.116778:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862784 00000100:00100000:2.0:1789892534.116813:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1789892534.116822:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:214040:x1876834915862784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.116918:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:214040:x1876834915862784:12345-0@lo:502:llog_process_th.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.116925:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:0.0:1789892534.116940:0:214040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214040:1876834915862784:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892534.116964:0:214040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:2.0:1789892534.117061:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:2.0:1789892534.117108:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892534.117117:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.117125:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892534.117141:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892534.117143:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:2.0:1789892534.117145:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892534.117167:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.117173:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.117179:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.117195:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.117223:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.117243:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.117274:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915862912 00000100:00100000:3.0:1789892534.117279:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915862912 00000100:00100000:3.0:1789892534.117306:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1789892534.117311:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915862912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892534.117318:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892534.117327:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213239 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.117339:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.117353:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.117358:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f400, rc 0) 00000100:00100000:3.0:1789892534.117392:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915862912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.117398:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1789892534.117436:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915862912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.117449:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.117456:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.117520:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.117543:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.117579:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863040 00000100:00100000:2.0:1789892534.117583:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.117585:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863040 00000100:00100000:0.0:1789892534.117617:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1789892534.117622:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915863040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.117699:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915863040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.117705:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:2.0:1789892534.117739:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.117773:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.117817:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.117837:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.117857:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863168 00000100:00100000:3.0:1789892534.117862:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863168 00000100:00100000:3.0:1789892534.117888:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1789892534.117896:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915863168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.117966:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915863168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.117972:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:2.0:1789892534.117995:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892534.118580:0:214041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:2.0:1789892534.118653:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:2.0:1789892534.118673:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892534.118679:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.118688:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892534.118713:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892534.118715:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 156 10000000:01000000:2.0:1789892534.118718:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892534.118733:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.118740:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.118747:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.118759:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.118784:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.118820:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863296 00000100:00100000:2.0:1789892534.118822:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.118827:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863296 00000100:00100000:0.0:1789892534.118858:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:0.0:1789892534.118863:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915863296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892534.118870:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892534.118881:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213247 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.118897:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.118905:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.118912:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892534.118945:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915863296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.118950:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1789892534.118983:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.119005:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.119014:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.119058:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.119089:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.119109:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.119133:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863424 00000100:00100000:3.0:1789892534.119139:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863424 00000100:00100000:3.0:1789892534.119167:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1789892534.119176:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915863424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.119258:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915863424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.119264:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1789892534.119298:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.119325:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.119362:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.119376:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.119395:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863552 00000100:00100000:0.0:1789892534.119402:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863552 00000100:00100000:0.0:1789892534.119460:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:0.0:1789892534.119469:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915863552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.119600:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915863552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.119611:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:2.0:1789892534.119629:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.119848:0:214042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214042:1876834915863680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.119895:0:214042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.119938:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863680 00000100:00100000:0.0:1789892534.119943:0:214042:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.119945:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863680 00000100:00100000:3.0:1789892534.119980:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1789892534.119988:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:214042:x1876834915863680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.120076:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:214042:x1876834915863680:12345-0@lo:502:llog_process_th.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.120084:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1789892534.120100:0:214042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214042:1876834915863680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.120159:0:214042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214042:1876834915863808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.120202:0:214042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.120225:0:214042:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.120253:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863808 00000100:00100000:2.0:1789892534.120260:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863808 00000100:00100000:2.0:1789892534.120293:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:2.0:1789892534.120308:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:214042:x1876834915863808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.120402:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:214042:x1876834915863808:12345-0@lo:502:llog_process_th.0 Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.120411:0:214042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214042:1876834915863808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.120413:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000040:00080000:0.0:1789892534.120448:0:214042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892534.120698:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892534.120718:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892534.120724:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.120733:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892534.120740:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892534.120742:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:3.0:1789892534.120744:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892534.120760:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.120766:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.120772:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892534.120783:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.120812:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.120837:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.120865:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915863936 00000100:00100000:2.0:1789892534.120872:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915863936 00000100:00100000:2.0:1789892534.120904:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1789892534.120912:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915863936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.120930:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892534.120939:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213255 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.120956:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.120966:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.120974:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffe00, rc 0) 00000100:00100000:2.0:1789892534.121017:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915863936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.121024:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1789892534.121046:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915863936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892534.121061:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.121076:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892534.121123:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.121158:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.121180:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.121210:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864064 00000100:00100000:2.0:1789892534.121217:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864064 00000100:00100000:2.0:1789892534.121248:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:2.0:1789892534.121257:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915864064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.121345:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915864064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.121354:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1789892534.121361:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.121393:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.121447:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.121471:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.121562:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864192 00000100:00100000:2.0:1789892534.121569:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864192 00000100:00100000:2.0:1789892534.121602:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1789892534.121613:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915864192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.121730:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915864192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.121748:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1789892534.121752:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892534.122370:0:214043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:2.0:1789892534.122486:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892534.122583:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892534.122591:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.122601:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892534.122609:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892534.122612:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 156 10000000:01000000:2.0:1789892534.122615:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892534.122634:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.122642:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.122650:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.122666:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.122697:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.122732:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b366c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.122749:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864320 00000100:00100000:0.0:1789892534.122755:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864320 00000100:00100000:0.0:1789892534.122787:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1789892534.122792:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915864320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892534.122800:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892534.122808:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213263 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.122821:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.122827:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.122839:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837e00, rc 0) 00000100:00100000:0.0:1789892534.122871:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915864320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.122879:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1789892534.122913:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.122925:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.122947:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.122985:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.123006:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.123021:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b366c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.123040:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864448 00000100:00100000:3.0:1789892534.123046:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864448 00000100:00100000:3.0:1789892534.123075:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1789892534.123080:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915864448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.123155:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915864448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.123161:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1789892534.123183:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.123205:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.123239:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.123252:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b366c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.123260:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864576 00000100:00100000:0.0:1789892534.123265:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864576 00000100:00100000:0.0:1789892534.123291:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1789892534.123296:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915864576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.123362:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915864576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.123369:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1789892534.123379:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.123602:0:214044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214044:1876834915864704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.123628:0:214044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.123646:0:214044:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.123660:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864704 00000100:00100000:3.0:1789892534.123666:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864704 00000100:00100000:3.0:1789892534.123692:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:3.0:1789892534.123699:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:214044:x1876834915864704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.123789:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:214044:x1876834915864704:12345-0@lo:502:llog_process_th.0 Request processed in 90us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.123801:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:2.0:1789892534.123840:0:214044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214044:1876834915864704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.123887:0:214044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214044:1876834915864832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.123925:0:214044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.123944:0:214044:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.123957:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864832 00000100:00100000:0.0:1789892534.123962:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864832 00000100:00100000:0.0:1789892534.123984:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1789892534.123990:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:214044:x1876834915864832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.124076:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:214044:x1876834915864832:12345-0@lo:502:llog_process_th.0 Request processed in 84us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.124084:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1789892534.124099:0:214044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214044:1876834915864832:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892534.124120:0:214044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892534.124170:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892534.124203:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892534.124213:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.124224:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892534.124234:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892534.124236:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 178 10000000:01000000:3.0:1789892534.124239:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892534.124260:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.124270:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.124279:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892534.124295:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.124325:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.124344:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.124357:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915864960 00000100:00100000:2.0:1789892534.124363:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915864960 00000100:00100000:2.0:1789892534.124395:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1789892534.124405:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915864960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.124412:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892534.124435:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213271 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.124447:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.124454:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.124459:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892534.124526:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915864960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.124531:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:3.0:1789892534.124543:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915864960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892534.124560:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.124577:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892534.124617:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.124642:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.124664:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.124686:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865088 00000100:00100000:0.0:1789892534.124691:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865088 00000100:00100000:0.0:1789892534.124717:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1789892534.124723:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915865088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.124797:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915865088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.124803:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:3.0:1789892534.124807:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.124855:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.124893:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.124908:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.124928:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865216 00000100:00100000:2.0:1789892534.124933:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865216 00000100:00100000:2.0:1789892534.124955:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1789892534.124964:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915865216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.125037:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915865216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.125044:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1789892534.125048:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.125245:0:214045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214045:1876834915865344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.125277:0:214045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.125293:0:214045:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.125310:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865344 00000100:00100000:0.0:1789892534.125316:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865344 00000100:00100000:0.0:1789892534.125338:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1789892534.125346:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:214045:x1876834915865344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.125443:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:214045:x1876834915865344:12345-0@lo:502:llog_process_th.0 Request processed in 95us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.125449:0:214045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214045:1876834915865344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.125451:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000020:01000000:3.0:1789892534.125521:0:214045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892534.125532:0:214045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892534.125535:0:214045:0:(obd_config.c:1561:class_process_config()) marker 168 (0x1) lustre-MDT0001-m del lustre.qpool2 00000020:00000080:3.0:1789892534.125540:0:214045:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1789892534.125617:0:214045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214045:1876834915865472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.125649:0:214045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.125670:0:214045:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.125688:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865472 00000100:00100000:2.0:1789892534.125695:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865472 00000100:00100000:2.0:1789892534.125727:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1789892534.125740:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:214045:x1876834915865472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.125835:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:214045:x1876834915865472:12345-0@lo:502:llog_process_th.0 Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.125839:0:214045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214045:1876834915865472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.125860:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1789892534.125890:0:214045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214045:1876834915865600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.125926:0:214045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.125942:0:214045:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.125960:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865600 00000100:00100000:0.0:1789892534.125964:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865600 00000100:00100000:0.0:1789892534.125987:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:0.0:1789892534.125994:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:214045:x1876834915865600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.126065:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:214045:x1876834915865600:12345-0@lo:502:llog_process_th.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.126073:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1789892534.126075:0:214045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214045:1876834915865600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892534.126104:0:214045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892534.126108:0:214045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892534.126110:0:214045:0:(obd_config.c:1561:class_process_config()) marker 168 (0x2) lustre-MDT0001-m del lustre.qpool2 00000040:00080000:3.0:1789892534.126112:0:214045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 182 count 178 00000020:01000000:2.0:1789892534.126176:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 178-181 (rc=0) 10000000:01000000:2.0:1789892534.126207:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892534.126214:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.126223:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892534.126232:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892534.126234:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 156 10000000:01000000:2.0:1789892534.126237:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892534.126255:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.126263:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.126272:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.126288:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.126317:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.126339:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.126347:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865728 00000100:00100000:3.0:1789892534.126353:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865728 00000100:00100000:3.0:1789892534.126382:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1789892534.126387:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915865728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892534.126395:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892534.126403:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021327f expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.126428:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 22 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.126436:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 22 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.126441:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e800, rc 0) 00000100:00100000:3.0:1789892534.126474:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915865728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.126480:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1789892534.126543:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.126555:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.126570:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.126604:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.126627:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.126649:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.126655:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865856 00000100:00100000:0.0:1789892534.126660:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865856 00000100:00100000:0.0:1789892534.126687:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:0.0:1789892534.126693:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915865856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.126748:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915865856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.126754:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1789892534.126759:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.126789:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.126828:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.126851:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.126852:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915865984 00000100:00100000:3.0:1789892534.126863:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915865984 00000100:00100000:3.0:1789892534.126885:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:3.0:1789892534.126891:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915865984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.126960:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915865984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.126967:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1789892534.126984:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915865984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.127178:0:214046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214046:1876834915866112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.127219:0:214046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.127240:0:214046:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.127240:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866112 00000100:00100000:0.0:1789892534.127245:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866112 00000100:00100000:0.0:1789892534.127271:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:0.0:1789892534.127279:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:214046:x1876834915866112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.127345:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:214046:x1876834915866112:12345-0@lo:502:llog_process_th.0 Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.127356:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1789892534.127367:0:214046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214046:1876834915866112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.127409:0:214046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214046:1876834915866240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.127459:0:214046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.127480:0:214046:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.127526:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866240 00000100:00100000:3.0:1789892534.127531:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866240 00000100:00100000:3.0:1789892534.127563:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1789892534.127569:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:214046:x1876834915866240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.127640:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:214046:x1876834915866240:12345-0@lo:502:llog_process_th.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.127646:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1789892534.127670:0:214046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214046:1876834915866240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892534.127699:0:214046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892534.127753:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892534.127791:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892534.127800:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.127811:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892534.127820:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789892534.127822:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 178 10000000:01000000:3.0:1789892534.127825:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892534.127845:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.127854:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.127872:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892534.127890:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915866368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.127923:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.127967:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866368 00000100:00100000:3.0:1789892534.127969:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.127973:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866368 00000100:00100000:0.0:1789892534.128003:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1789892534.128009:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915866368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892534.128016:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892534.128023:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021328d expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.128036:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.128043:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.128048:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837a00, rc 0) 00000100:00100000:0.0:1789892534.128078:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915866368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.128087:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:3.0:1789892534.128116:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915866368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892534.128133:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892534.128144:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892534.128195:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915866496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.128231:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.128255:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.128280:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866496 00000100:00100000:2.0:1789892534.128288:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866496 00000100:00100000:2.0:1789892534.128330:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1789892534.128339:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915866496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.128438:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915866496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.128447:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1789892534.128462:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915866496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.128554:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915866624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.128602:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892534.128645:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866624 00000100:00100000:3.0:1789892534.128651:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.128651:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866624 00000100:00100000:0.0:1789892534.128681:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1789892534.128687:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915866624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892534.128753:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915866624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.128762:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1789892534.128788:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915866624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.129026:0:214047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214047:1876834915866752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.129070:0:214047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.129099:0:214047:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.129116:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866752 00000100:00100000:2.0:1789892534.129123:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866752 00000100:00100000:2.0:1789892534.129155:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1789892534.129164:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:214047:x1876834915866752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.129273:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:214047:x1876834915866752:12345-0@lo:502:llog_process_th.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892534.129282:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1789892534.129292:0:214047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214047:1876834915866752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892534.129322:0:214047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892534.129330:0:214047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892534.129332:0:214047:0:(obd_config.c:1561:class_process_config()) marker 167 (0x1) lustre-MDT0000-m del lustre.qpool2 00000020:00000080:3.0:1789892534.129337:0:214047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1789892534.129970:0:214047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214047:1876834915866880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.130003:0:214047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.130027:0:214047:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.130045:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915866880 00000100:00100000:0.0:1789892534.130056:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915866880 00000100:00100000:0.0:1789892534.130082:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:0.0:1789892534.130088:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:214047:x1876834915866880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892534.130157:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:214047:x1876834915866880:12345-0@lo:502:llog_process_th.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.130164:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1789892534.130171:0:214047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214047:1876834915866880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.130214:0:214047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214047:1876834915867008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892534.130246:0:214047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892534.130262:0:214047:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892534.130290:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867008 00000100:00100000:2.0:1789892534.130297:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867008 00000100:00100000:2.0:1789892534.130338:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1789892534.130352:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:214047:x1876834915867008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.130457:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:214047:x1876834915867008:12345-0@lo:502:llog_process_th.0 Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.130465:0:214047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:214047:1876834915867008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892534.130467:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000020:01000000:3.0:1789892534.130525:0:214047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892534.130529:0:214047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892534.130532:0:214047:0:(obd_config.c:1561:class_process_config()) marker 167 (0x2) lustre-MDT0000-m del lustre.qpool2 00000040:00080000:3.0:1789892534.130537:0:214047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 182 count 178 00000020:01000000:2.0:1789892534.130619:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 178-181 (rc=0) 10000000:01000000:2.0:1789892534.130662:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892534.130670:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.130681:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892534.130704:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892534.130707:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892534.130709:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892534.130728:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.130735:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.130744:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.130760:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915867136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.130789:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.130818:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892534.130831:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867136 00000100:00100000:0.0:1789892534.130837:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867136 00000100:00100000:0.0:1789892534.130863:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:0.0:1789892534.130868:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915867136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892534.130875:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892534.130884:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021329b expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.130900:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.130909:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892534.130918:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892534.130948:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915867136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.130952:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1789892534.130983:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915867136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892534.130995:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.131004:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.131040:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915867264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892534.131065:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892534.131083:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892534.131097:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867264 00000100:00100000:3.0:1789892534.131105:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867264 00000100:00100000:3.0:1789892534.131143:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1789892534.131154:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915867264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892534.131234:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915867264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (166us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892534.131245:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1789892534.131266:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915867264:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892534.131301:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892534.131306:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892534.131314:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892534.159358:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892534.159395:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892534.159452:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844480 00000100:00100000:3.0:1789892534.159460:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844608 00000100:00100000:0.0:1789892534.159463:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844480 00000100:00100000:3.0:1789892534.159486:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844608 00000100:00080000:2.0:1789892534.159538:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789892534.159545:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892534.159598:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 449 00000100:00100000:0.0:1789892534.159611:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 450 00000100:00100000:3.0:1789892534.159618:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925844608:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892534.159630:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2402:x1876834925844480:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1789892534.159711:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925844608:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 101us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892534.159712:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2402:x1876834925844480:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892534.159742:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 449 00000100:00100000:0.0:1789892534.159749:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 450 00010000:00010000:2.0:1789892535.074693:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892535.435264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892535.435324:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844736 00000100:00100000:1.0:1789892535.435336:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844736 00000100:00100000:1.0:1789892535.435411:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2775 00000100:00100000:1.0:1789892535.435422:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:212937:x1876834925844736:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:1.0:1789892535.435449:0:191135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892535.435478:0:191135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801400/0x5c4f93dd002132a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5ce expref: -99 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435611:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435628:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435640:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435652:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435657:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435664:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435745:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800600/0x5c4f93dd002132be lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435750:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800600/0x5c4f93dd002132be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435755:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800600/0x5c4f93dd002132be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892535.435795:0:191135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00000004:00200000:1.0:1789892535.435798:0:191135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789892535.435816:0:191135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800600/0x5c4f93dd002132be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435838:0:191135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435843:0:191135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435849:0:191135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435853:0:191135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800400 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892535.435857:0:191135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435862:0:191135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435873:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9aded00) 00010000:00010000:1.0:1789892535.435875:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892535.435879:0:191135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435884:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd002132b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435892:0:191135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435897:0:191135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435901:0:191135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435911:0:191135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801e00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892535.435915:0:191135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435922:0:191135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435932:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff906983745000) 00010000:00010000:1.0:1789892535.435935:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892535.435938:0:191135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435945:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd002132b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435977:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801400/0x5c4f93dd002132a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ce expref: 8 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435988:0:191135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800600/0x5c4f93dd002132be lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ce expref: 7 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.435994:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff906983745600) 00010000:00010000:1.0:1789892535.435996:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789892535.435998:0:191135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800600, rc 0) 00000100:00100000:1.0:1789892535.436060:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+7:212937:x1876834925844736:12345-192.168.204.33@tcp:101:rm.0 Request processed in 641us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892535.436065:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2775 00000100:00100000:1.0:1789892535.437378:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892535.437445:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925844992 00000100:00100000:2.0:1789892535.437450:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925844992 00000100:00100000:2.0:1789892535.437486:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2776 00000100:00100000:2.0:1789892535.437519:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+7:212937:x1876834925844992:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:2.0:1789892535.437528:0:189439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892535.437538:0:189439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe400/0x5c4f93dd002132c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5d5 expref: -99 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789892535.437596:0:189439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00010000:00010000:2.0:1789892535.437705:0:189439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe400/0x5c4f93dd002132c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5d5 expref: 9 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.437716:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9aded00) 00010000:00010000:2.0:1789892535.437718:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789892535.437721:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe400/0x5c4f93dd002132c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5d5 expref: 9 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.437736:0:189439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe400, rc 0) 00000100:00100000:2.0:1789892535.437765:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+8:212937:x1876834925844992:12345-192.168.204.33@tcp:101:rm.0 Request processed in 249us (388us total) trans 12884904333 rc 301/301 00000100:00100000:2.0:1789892535.437771:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2776 00000100:00100000:2.0:1789892535.439555:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892535.439601:0:189442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925845120 00000100:00100000:0.0:1789892535.439607:0:189442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925845120 00000100:00100000:0.0:1789892535.439643:0:189442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 191 00000100:00100000:0.0:1789892535.439651:0:189442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af48c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:082b2a23-8951-488c-926f-5ad884776d61+8:212937:x1876834925845120:12345-192.168.204.33@tcp:37:rm.0 00000100:00100000:2.0:1789892535.441813:0:189442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af48c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:082b2a23-8951-488c-926f-5ad884776d61+8:212937:x1876834925845120:12345-192.168.204.33@tcp:37:rm.0 Request processed in 2158us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892535.441827:0:189442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 191 00000100:00100000:1.0:1789892535.443248:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892535.443302:0:189441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925845376 00000100:00100000:3.0:1789892535.443316:0:189441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925845376 00000100:00100000:3.0:1789892535.443370:0:189441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 192 00000100:00100000:3.0:1789892535.443384:0:189441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:082b2a23-8951-488c-926f-5ad884776d61+8:212937:x1876834925845376:12345-192.168.204.33@tcp:35:rm.0 00000100:00100000:3.0:1789892535.443633:0:189441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:082b2a23-8951-488c-926f-5ad884776d61+9:212937:x1876834925845376:12345-192.168.204.33@tcp:35:rm.0 Request processed in 254us (387us total) trans 12884904334 rc 0/0 00000100:00100000:3.0:1789892535.443639:0:189441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 192 00000100:00100000:0.0:1789892535.444626:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892535.444672:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925845632 00000100:00100000:3.0:1789892535.444678:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925845632 00000100:00100000:3.0:1789892535.444711:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2777 00000100:00100000:3.0:1789892535.444717:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+9:212937:x1876834925845632:12345-192.168.204.33@tcp:36:rm.0 00010000:00010000:3.0:1789892535.444750:0:196796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789892535.444773:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800600/0x5c4f93dd002132be lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ce expref: 9 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444788:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff906983745600) 00010000:00010000:3.0:1789892535.444801:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e000/0x5c4f93dd00212d38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a534 expref: 8 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444809:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9aded00) 00010000:00010000:3.0:1789892535.444825:0:196796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892535.444845:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444854:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444862:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444869:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444874:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444879:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444940:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444945:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.444950:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789892535.445102:0:196796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00010000:00010000:3.0:1789892535.445112:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445117:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445127:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445132:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878fc00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892535.445135:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445140:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445147:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff906993e78a00) 00010000:00010000:3.0:1789892535.445149:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789892535.445152:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445156:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd002132e1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445169:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445173:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445177:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445180:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ec00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892535.445182:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445193:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445198:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906993e78100) 00010000:00010000:3.0:1789892535.445200:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892535.445201:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445205:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd002132d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789892535.445212:0:196796:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000ee18f0b6 reply state 000000001ed523e4 transno 12884904335 ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445219:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892535.445222:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff906993e78d00) 00010000:00010000:3.0:1789892535.445224:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789892535.445225:0:196796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789892535.445263:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+9:212937:x1876834925845632:12345-192.168.204.33@tcp:36:rm.0 Request processed in 546us (641us total) trans 12884904335 rc 0/0 00000100:00100000:3.0:1789892535.445268:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2777 00000100:00100000:0.0:1789892535.446667:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892535.446713:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925845760 00000100:00100000:1.0:1789892535.446722:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925845760 00000100:00100000:1.0:1789892535.446766:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2778 00000100:00100000:1.0:1789892535.446774:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+9:211407:x1876834925845760:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:1.0:1789892535.446788:0:191771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892535.446802:0:191771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd002132e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5dc expref: -99 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.446842:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800c00/0x5c4f93dd002132ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.446853:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800c00/0x5c4f93dd002132ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.446862:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800c00/0x5c4f93dd002132ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892535.446890:0:191771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789892535.446893:0:191771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789892535.446906:0:191771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800c00/0x5c4f93dd002132ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.446932:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd002132e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5dc expref: 11 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.446954:0:191771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800c00/0x5c4f93dd002132ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5dc expref: 10 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892535.446966:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983745400) 00010000:00010000:1.0:1789892535.446980:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789892535.446984:0:191771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800c00, rc 0) 00000100:00100000:1.0:1789892535.447029:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+10:211407:x1876834925845760:12345-192.168.204.33@tcp:101:bash.0 Request processed in 255us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892535.447036:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2778 00000100:00100000:1.0:1789892535.447963:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892535.448057:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925845888 00000100:00100000:2.0:1789892535.448064:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925845888 00000100:00100000:2.0:1789892535.448107:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2779 00000100:00100000:2.0:1789892535.448118:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+10:211407:x1876834925845888:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:2.0:1789892535.448128:0:189440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892535.448139:0:189440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffee00/0x5c4f93dd002132f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5e3 expref: -99 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448189:0:189440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448204:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448218:0:189440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448237:0:189440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448256:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448264:0:189440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448287:0:189440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448293:0:189440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448299:0:189440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448304:0:189440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffc00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892535.448307:0:189440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448313:0:189440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448320:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983745400) 00010000:00010000:2.0:1789892535.448322:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892535.448325:0:189440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448331:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd002132fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448340:0:189440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448352:0:189440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448357:0:189440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448361:0:189440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff800 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892535.448364:0:189440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448369:0:189440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448375:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bd617dd (ffff9069873d1900) 00010000:00010000:2.0:1789892535.448377:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892535.448379:0:189440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448384:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884fff800/0x5c4f93dd00213304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448426:0:189440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffee00/0x5c4f93dd002132f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5e3 expref: 11 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448435:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983745400) 00010000:00010000:2.0:1789892535.448437:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892535.448440:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffee00/0x5c4f93dd002132f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5e3 expref: 11 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892535.448459:0:189440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffee00, rc 0) 00000100:00100000:2.0:1789892535.448529:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+10:211407:x1876834925845888:12345-192.168.204.33@tcp:101:bash.0 Request processed in 411us (565us total) trans 0 rc 301/301 00000100:00100000:2.0:1789892535.448539:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2779 00010000:00010000:0.0:1789892536.098682:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892536.098722:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915867392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892536.098805:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892536.098857:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867392 00000100:00100000:0.0:1789892536.098867:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867392 00000100:00100000:0.0:1789892536.098929:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789892536.098939:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915867392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789892536.098980:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789892536.099036:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915867392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892536.099042:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789892536.099073:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915867392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789892536.610631:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915867520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892536.610732:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892536.610776:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867520 00000100:00100000:3.0:1789892536.610785:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867520 00000100:00100000:3.0:1789892536.610843:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789892536.610853:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915867520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789892536.610894:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445875712 avail 1299636224 00000100:00100000:3.0:1789892536.610956:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915867520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892536.610969:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789892536.611005:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915867520:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789892536.611338:0:214272:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789892536.611346:0:214272:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:2.0:1789892536.625265:0:214279:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789892536.625275:0:214279:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000001:00080000:2.0:1789892537.049097:0:189419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904335 is committed 00010000:00010000:3.0:1789892537.049161:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.049175:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.049182:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.049188:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f000 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892537.049191:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.049197:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.049213:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff906993e78d00) 00010000:00010000:3.0:1789892537.049216:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892537.049219:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.049224:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd002132da lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892537.122667:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789892537.122685:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915867776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892537.122685:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915867904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892537.122695:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892537.122798:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892537.122835:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892537.122862:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.122911:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867776 00000100:00100000:1.0:1789892537.122919:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915867648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892537.122920:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867776 00000100:00100000:1.0:1789892537.122985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.122997:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868032 00000100:00100000:2.0:1789892537.123000:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868032 00000100:00100000:2.0:1789892537.123036:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867648 00000100:00100000:1.0:1789892537.123036:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915868544:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.123049:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867648 00000100:00100000:0.0:1789892537.123066:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789892537.123080:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892537.123087:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915867776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892537.123093:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789892537.123106:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915868032:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892537.123107:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915869056:0@lo:400:kworker.0 00002000:00000024:0.0:1789892537.123129:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789892537.123150:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892537.123163:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892537.123211:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915867776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.123219:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789892537.123223:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915869568:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.123233:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915868032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.123251:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789892537.123272:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892537.123273:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892537.123294:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915867648:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789892537.123302:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789892537.123310:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789892537.123313:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868544 00000100:00100000:0.0:1789892537.123320:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868544 00002000:00000024:3.0:1789892537.123324:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892537.123329:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869056 00000100:00100000:2.0:1789892537.123334:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869056 00000100:00100000:1.0:1789892537.123367:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892537.123386:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869568 00000100:00100000:0.0:1789892537.123392:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869568 00000100:00100000:2.0:1789892537.123405:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1789892537.123423:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915868544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.123433:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915867648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.123449:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789892537.123454:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915867648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892537.123469:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915869056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.123479:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892537.123532:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789892537.123546:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915868544:12345-0@lo:400:kworker.0 Request processed in 78us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.123548:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915869056:12345-0@lo:400:kworker.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.123561:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1789892537.123561:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915868160:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.123575:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789892537.123605:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789892537.123618:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915869568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892537.123631:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789892537.123632:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892537.123664:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.123676:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915869568:12345-0@lo:400:kworker.0 Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.123687:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1789892537.123735:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915868672:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.123743:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915868288:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.123773:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915868416:0@lo:400:kworker.0 00000100:00100000:1.0:1789892537.123788:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892537.123823:0:190946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915867904 00000100:00100000:0.0:1789892537.123827:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868160 00000100:00100000:3.0:1789892537.123833:0:190946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915867904 00000100:00100000:0.0:1789892537.123836:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868160 00000100:00100000:2.0:1789892537.123842:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892537.123848:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915869184:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.123878:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915868928:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.123909:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1789892537.123911:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892537.123917:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789892537.123928:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892537.123939:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915868160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.123952:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915867904:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892537.123970:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1876834915869440:0@lo:400:kworker.0 00002000:00000024:3.0:1789892537.123976:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892537.123989:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915868544:0@lo:400:kworker.0 00000100:00100000:1.0:1789892537.124017:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915869056:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124026:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892537.124048:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915868160:12345-0@lo:400:kworker.0 Request processed in 113us (417us total) trans 0 rc 0/0 00010000:00080000:1.0:1789892537.124051:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688b20ca80 x1876834915869568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892537.124077:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915867904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.124083:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1789892537.124085:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915869568:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124101:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915867776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892537.124108:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789892537.124167:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868672 00000100:00100000:1.0:1789892537.124169:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915868160:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124177:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868672 00000100:00100000:2.0:1789892537.124181:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868416 00000100:00100000:3.0:1789892537.124183:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869184 00000100:00100000:2.0:1789892537.124187:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868416 00000100:00100000:3.0:1789892537.124192:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869184 00000100:00080000:1.0:1789892537.124228:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789892537.124236:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892537.124258:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868928 00000100:00100000:0.0:1789892537.124258:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789892537.124262:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869440 00000100:00100000:2.0:1789892537.124269:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868928 00000100:00100000:1.0:1789892537.124270:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892537.124274:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869440 00000100:00100000:0.0:1789892537.124283:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915868672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892537.124312:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915868800:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124322:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789892537.124335:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915868416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.124352:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789892537.124374:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892537.124388:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915869184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124394:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915868672:12345-0@lo:400:kworker.0 Request processed in 114us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.124411:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789892537.124423:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1876834915869312:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124424:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915868416:12345-0@lo:400:kworker.0 Request processed in 91us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.124433:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868288 00000100:00100000:0.0:1789892537.124445:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868288 00000100:00100000:2.0:1789892537.124447:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789892537.124463:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915869184:12345-0@lo:400:kworker.0 Request processed in 80us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.124468:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915868800 00000100:00100000:2.0:1789892537.124474:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915868800 00000100:00100000:3.0:1789892537.124480:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789892537.124524:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789892537.124532:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789892537.124538:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915868288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892537.124544:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.124546:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915868928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.124561:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789892537.124580:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+8:3622:x1876834915869440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124618:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915868928:12345-0@lo:400:kworker.0 Request processed in 78us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.124631:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789892537.124631:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915867904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892537.124634:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915868288:12345-0@lo:400:kworker.0 Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.124662:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+8:3622:x1876834915869440:12345-0@lo:400:kworker.0 Request processed in 85us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.124663:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789892537.124665:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789892537.124684:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915868800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.124690:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789892537.124696:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915868288:0@lo:400:kworker.0 00000100:00100000:3.0:1789892537.124734:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869312 00000100:00100000:2.0:1789892537.124740:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915868800:12345-0@lo:400:kworker.0 Request processed in 55us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.124743:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869312 00000100:00100000:2.0:1789892537.124750:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789892537.124754:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915868800:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124796:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915868672:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124820:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00080000:1.0:1789892537.124822:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789892537.124832:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892537.124837:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876834915869312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124840:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915869184:0@lo:400:kworker.0 00000100:00100000:2.0:1789892537.124894:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876834915869312:12345-0@lo:400:kworker.0 Request processed in 62us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.124901:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00010000:00080000:1.0:1789892537.124924:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688b20ce00 x1876834915869312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892537.124940:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1876834915869312:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124955:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915868416:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124973:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915868928:0@lo:400:kworker.0 00000100:00100000:0.0:1789892537.124987:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1876834915869440:0@lo:400:kworker.0 00000004:00080000:1.0:1789892537.468167:0:214385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3362616673905ns, next at 3277500567060ns, rc = 0 00080000:00080000:1.0:1789892537.468182:0:214385:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789892537.468269:0:214385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3362616776692ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789892537.468277:0:214385:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789892537.468399:0:214385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3362616907550ns, next at 3206864919340ns, rc = 0 00080000:00080000:1.0:1789892537.468407:0:214385:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789892537.468511:0:214385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3362617019154ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789892537.468520:0:214385:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789892537.468908:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 35 committed 00000004:00080000:0.0:1789892537.468927:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00000004:00080000:3.0:1789892537.469281:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 35 committed 00000004:00080000:0.0:1789892537.469308:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00000100:00100000:0.0:1789892537.888039:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892537.888080:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846016 00000100:00100000:1.0:1789892537.888091:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846016 00000100:00080000:3.0:1789892537.888155:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892537.888180:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2780 00000100:00100000:1.0:1789892537.888192:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:213261:x1876834925846016:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:1.0:1789892537.890689:0:189440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915869696:0@lo:106: 00000100:00100000:1.0:1789892537.890733:0:189440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.890757:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869696 00000100:00100000:2.0:1789892537.890763:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869696 00000100:00100000:1.0:1789892537.890791:0:189440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915869824:0@lo:106: 00000100:00100000:2.0:1789892537.890806:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789892537.890817:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-OST0001+8:189440:x1876834915869696:12345-0@lo:106: 00010000:00010000:2.0:1789892537.890828:0:193633:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892537.890828:0:189440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892537.890845:0:193633:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892537.890864:0:189440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915869952:0@lo:106: 00000100:00100000:3.0:1789892537.890872:0:189422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789892537.890891:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869824 00000100:00100000:3.0:1789892537.890896:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869824 00000100:00100000:1.0:1789892537.890902:0:189440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.890912:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-OST0001+8:189440:x1876834915869696:12345-0@lo:106: Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.890923:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789892537.890936:0:189440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915870080:0@lo:106: 00000100:00100000:3.0:1789892537.890939:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915869952 00000100:00100000:3.0:1789892537.890945:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915869952 00000100:00100000:2.0:1789892537.890953:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789892537.890964:0:189440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.890968:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b356050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-OST0000+8:189440:x1876834915869824:12345-0@lo:106: 00010000:00010000:2.0:1789892537.890980:0:193633:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892537.890982:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870080 00000100:00100000:3.0:1789892537.890989:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870080 00010000:00010000:2.0:1789892537.890989:0:193633:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892537.890995:0:189440:0:(client.c:2702:ptlrpc_set_wait()) set ffff906883e13c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892537.891021:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789892537.891029:0:189440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915869696:0@lo:106: 00000100:00100000:3.0:1789892537.891033:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:189440:x1876834915869952:12345-0@lo:106: 00010000:00010000:3.0:1789892537.891043:0:189422:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892537.891051:0:189422:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892537.891059:0:189440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915869824:0@lo:106: 00000100:00100000:2.0:1789892537.891061:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b356050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-OST0000+8:189440:x1876834915869824:12345-0@lo:106: Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.891074:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1789892537.891116:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:189440:x1876834915869952:12345-0@lo:106: Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.891122:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1789892537.891133:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789892537.891134:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-MDT0000+7:189440:x1876834915870080:12345-0@lo:106: 00010000:00010000:2.0:1789892537.891143:0:193633:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892537.891149:0:193633:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892537.891168:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876834915870208:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892537.891196:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-MDT0000+7:189440:x1876834915870080:12345-0@lo:106: Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.891212:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892537.891213:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1789892537.891268:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915870336:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892537.891302:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892537.891329:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789892537.891332:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915870592:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892537.891353:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915870464:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892537.891390:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892537.891423:0:189442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870208 00000100:00100000:1.0:1789892537.891427:0:189442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870208 00000100:00100000:0.0:1789892537.891451:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892537.891463:0:189442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870336 00000100:00100000:1.0:1789892537.891466:0:189442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870336 00000100:00100000:1.0:1789892537.891487:0:189442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870592 00000100:00100000:1.0:1789892537.891535:0:189442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870592 00000100:00100000:3.0:1789892537.891548:0:193748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870464 00000100:00100000:3.0:1789892537.891555:0:193748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870464 00000100:00100000:1.0:1789892537.891560:0:189442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789892537.891570:0:189442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+12:3620:x1876834915870208:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892537.891584:0:193748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789892537.891594:0:193748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0001_UUID+12:3621:x1876834915870336:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892537.891612:0:189442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+12:3620:x1876834915870208:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 46us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892537.891618:0:189442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789892537.891633:0:189442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789892537.891640:0:189442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+12:3619:x1876834915870592:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892537.891650:0:193748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915870336:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 57us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.891658:0:193748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789892537.891673:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915870336:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892537.891680:0:193748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789892537.891685:0:189442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+12:3619:x1876834915870592:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 46us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.891691:0:193748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+12:3621:x1876834915870464:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892537.891695:0:189442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789892537.891717:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915870592:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892537.891747:0:193748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915870464:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.891754:0:193748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789892537.891759:0:189440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915869952:0@lo:106: 00000100:00100000:0.0:1789892537.891764:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915870464:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892537.891782:0:189440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:189440:1876834915870080:0@lo:106: 00000100:00100000:3.0:1789892537.891803:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876834915870208:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892537.891869:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:213261:x1876834925846016:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 3678us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892537.891876:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2780 00000100:00100000:0.0:1789892537.905545:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892537.905586:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846144 00000100:00100000:1.0:1789892537.905596:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846144 00000100:00100000:1.0:1789892537.905645:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2781 00000100:00100000:1.0:1789892537.905656:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:213264:x1876834925846144:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:1.0:1789892537.906972:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:213264:x1876834925846144:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1315us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892537.906983:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2781 00000100:00100000:0.0:1789892537.921724:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892537.921770:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846272 00000100:00100000:2.0:1789892537.921779:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846272 00000100:00100000:2.0:1789892537.921832:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2782 00000100:00100000:2.0:1789892537.921841:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:213267:x1876834925846272:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892537.923914:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:213267:x1876834925846272:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 2069us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.923927:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2782 00000100:00100000:0.0:1789892537.937112:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892537.937161:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846400 00000100:00100000:2.0:1789892537.937170:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846400 00000100:00100000:2.0:1789892537.937214:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2783 00000100:00100000:2.0:1789892537.937222:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:213270:x1876834925846400:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:2.0:1789892537.938921:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:213270:x1876834925846400:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1698us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892537.938928:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2783 00000100:00100000:2.0:1789892537.951413:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892537.951463:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846528 00000100:00100000:0.0:1789892537.951481:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846528 00000100:00100000:0.0:1789892537.951567:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2784 00000100:00100000:0.0:1789892537.951580:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:213273:x1876834925846528:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:0.0:1789892537.953209:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:213273:x1876834925846528:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1631us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892537.953219:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2784 00000100:00100000:0.0:1789892537.960037:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892537.960084:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846656 00000100:00100000:3.0:1789892537.960092:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846656 00000100:00100000:3.0:1789892537.960128:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2785 00000100:00100000:3.0:1789892537.960135:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:213274:x1876834925846656:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892537.961588:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:213274:x1876834925846656:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1451us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.961595:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2785 00000100:00100000:2.0:1789892537.968789:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892537.968858:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846784 00000100:00100000:1.0:1789892537.968867:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846784 00000100:00100000:1.0:1789892537.968918:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2786 00000100:00100000:1.0:1789892537.968930:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:213275:x1876834925846784:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:1.0:1789892537.970627:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:213275:x1876834925846784:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1698us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892537.970636:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2786 00000100:00100000:2.0:1789892537.976391:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892537.976434:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925846912 00000100:00100000:3.0:1789892537.976439:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925846912 00000100:00100000:3.0:1789892537.976469:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2787 00000100:00100000:3.0:1789892537.976475:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688e9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:213276:x1876834925846912:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892537.978114:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688e9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:213276:x1876834925846912:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1637us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892537.978122:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2787 00010000:00010000:1.0:1789892538.146673:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892539.170679:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892539.279257:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892539.279296:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892539.279306:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847040 00000100:00100000:3.0:1789892539.279331:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847040 00000100:00100000:2.0:1789892539.279344:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892539.279373:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847168 00000100:00100000:0.0:1789892539.279380:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847168 00000100:00100000:3.0:1789892539.279387:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1984 00000100:00100000:2.0:1789892539.279392:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847296 00000100:00100000:3.0:1789892539.279399:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2402:x1876834925847040:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892539.279399:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847296 00000100:00100000:0.0:1789892539.279431:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 457 00000100:00100000:0.0:1789892539.279441:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:2401:x1876834925847168:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892539.279452:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 458 00000100:00100000:2.0:1789892539.279466:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+5:2402:x1876834925847296:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1789892539.279471:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2402:x1876834925847040:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892539.279480:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:2401:x1876834925847168:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892539.279482:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1984 00000100:00100000:0.0:1789892539.279515:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 457 00000100:00080000:0.0:1789892539.279538:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789892539.279544:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892539.279545:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+5:2402:x1876834925847296:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892539.279557:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 458 00000001:02000400:3.0:1789892539.509784:0:214481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 04:22:18 (1789892538) 00010000:00010000:2.0:1789892540.194596:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789892540.585171:0:214652:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892540.585178:0:214652:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:2.0:1789892540.609157:0:214664:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789892540.609164:0:214664:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789892540.623712:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892540.623756:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847424 00000100:00100000:3.0:1789892540.623766:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847424 00000100:00100000:3.0:1789892540.623827:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2788 00000100:00100000:3.0:1789892540.623841:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:213571:x1876834925847424:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:3.0:1789892540.623864:0:191771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892540.623884:0:191771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021330b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5ea expref: -99 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.623943:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.623958:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.623972:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.623988:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.623994:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.623999:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624045:0:191771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624050:0:191771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624055:0:191771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624060:0:191771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f000 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892540.624063:0:191771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624069:0:191771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624078:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983745400) 00010000:00010000:3.0:1789892540.624080:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892540.624084:0:191771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624088:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f000/0x5c4f93dd00213312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624096:0:191771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624101:0:191771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624105:0:191771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624116:0:191771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ec00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892540.624119:0:191771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624123:0:191771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624130:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff9069a9ade100) 00010000:00010000:3.0:1789892540.624132:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892540.624134:0:191771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624138:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd00213319 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624165:0:191771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021330b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ea expref: 7 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624173:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983745400) 00010000:00010000:3.0:1789892540.624176:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892540.624179:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021330b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ea expref: 7 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.624189:0:191771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fc00, rc 0) 00000100:00100000:3.0:1789892540.624243:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:213571:x1876834925847424:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 406us (538us total) trans 0 rc 301/301 00000100:00100000:3.0:1789892540.624249:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2788 00000100:00100000:3.0:1789892540.625900:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892540.625939:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847680 00000100:00100000:0.0:1789892540.625944:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847680 00000100:00100000:0.0:1789892540.625978:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2789 00000100:00100000:0.0:1789892540.625986:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:213571:x1876834925847680:12345-192.168.204.33@tcp:36:lfs.0 00010000:00010000:0.0:1789892540.626015:0:191135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892540.626029:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800c00/0x5c4f93dd002132ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5dc expref: 6 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626051:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983745400) 00010000:00010000:0.0:1789892540.626058:0:191135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892540.626086:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626093:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626099:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626109:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626114:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626119:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626613:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626621:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626628:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789892540.626637:0:191135:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000042a1256a reply state 00000000326fe118 transno 12884904336 ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626656:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626661:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90698683a000) 00010000:00010000:0.0:1789892540.626663:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789892540.626666:0:191135:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789892540.626669:0:191135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:0.0:1789892540.626676:0:191135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626681:0:191135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626686:0:191135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626690:0:191135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836800 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:0.0:1789892540.626694:0:191135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626699:0:191135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626707:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90698683a100) 00010000:00010000:0.0:1789892540.626710:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892540.626712:0:191135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626716:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd00213320 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789892540.626745:0:191135:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000042a1256a reply state 00000000326fe118 transno 12884904336 ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626751:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.626756:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff90698683a300) 00010000:00010000:0.0:1789892540.626758:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789892540.626760:0:191135:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789892540.626805:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+7:213571:x1876834925847680:12345-192.168.204.33@tcp:36:lfs.0 Request processed in 820us (905us total) trans 12884904336 rc 0/0 00000100:00100000:0.0:1789892540.626811:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2789 00000100:00100000:0.0:1789892540.631662:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892540.631699:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847808 00000100:00100000:3.0:1789892540.631706:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847808 00000100:00100000:3.0:1789892540.631749:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2790 00000100:00100000:3.0:1789892540.631759:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+7:213572:x1876834925847808:12345-192.168.204.33@tcp:101:chmod.0 00010000:00010000:3.0:1789892540.631773:0:189438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892540.631786:0:189438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e000/0x5c4f93dd00213335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5f1 expref: -99 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.631824:0:189438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021333c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.631833:0:189438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021333c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.631843:0:189438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021333c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789892540.631880:0:189438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789892540.631885:0:189438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789892540.631902:0:189438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021333c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.631920:0:189438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e000/0x5c4f93dd00213335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5f1 expref: 9 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.631934:0:189438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021333c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5f1 expref: 8 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.631941:0:189438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9ade100) 00010000:00010000:3.0:1789892540.631943:0:189438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789892540.631951:0:189438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fc00, rc 0) 00000100:00100000:3.0:1789892540.631988:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+8:213572:x1876834925847808:12345-192.168.204.33@tcp:101:chmod.0 Request processed in 232us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892540.631994:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2790 00000100:00100000:3.0:1789892540.632803:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892540.632846:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925847936 00000100:00100000:0.0:1789892540.632852:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925847936 00000100:00100000:0.0:1789892540.632884:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2791 00000100:00100000:0.0:1789892540.632892:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+8:213572:x1876834925847936:12345-192.168.204.33@tcp:101:chmod.0 00010000:00010000:0.0:1789892540.632900:0:196796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892540.632909:0:196796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837000/0x5c4f93dd00213343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5f8 expref: -99 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.632938:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.632946:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.632952:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.632969:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.632978:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.632987:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633035:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd00213358 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633042:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd00213358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633049:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd00213358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892540.633067:0:196796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000004:00200000:0.0:1789892540.633069:0:196796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892540.633079:0:196796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd00213358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633086:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633091:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633097:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633110:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836e00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:0.0:1789892540.633113:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633118:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633129:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9ade100) 00010000:00010000:0.0:1789892540.633132:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892540.633136:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633143:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836e00/0x5c4f93dd0021334a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633157:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633165:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633173:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633178:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837600 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:0.0:1789892540.633181:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633185:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633203:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff90698683a300) 00010000:00010000:0.0:1789892540.633205:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892540.633208:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633213:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd00213351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633235:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837000/0x5c4f93dd00213343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5f8 expref: 10 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633244:0:196796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd00213358 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5f8 expref: 9 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892540.633250:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90698683a000) 00010000:00010000:0.0:1789892540.633252:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892540.633253:0:196796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836200, rc 0) 00000100:00100000:0.0:1789892540.633299:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+9:213572:x1876834925847936:12345-192.168.204.33@tcp:101:chmod.0 Request processed in 395us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892540.633305:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2791 00000100:00100000:0.0:1789892540.634334:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892540.634372:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848192 00000100:00100000:3.0:1789892540.634378:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848192 00000100:00100000:3.0:1789892540.634416:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2792 00000100:00100000:3.0:1789892540.634424:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+9:213572:x1876834925848192:12345-192.168.204.33@tcp:36:chmod.0 00010000:00010000:3.0:1789892540.634447:0:189440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892540.634461:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd00213358 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5f8 expref: 9 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.634473:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90698683a000) 00010000:00010000:3.0:1789892540.634476:0:189440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892540.634546:0:189440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.634555:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.634562:0:189440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789892540.634650:0:189440:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000003aa3a92e reply state 00000000ddc5706c transno 12884904337 ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.634659:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892540.634675:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90698683a000) 00010000:00010000:3.0:1789892540.634677:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789892540.634679:0:189440:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789892540.634684:0:189440:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000100:00100000:3.0:1789892540.634733:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+10:213572:x1876834925848192:12345-192.168.204.33@tcp:36:chmod.0 Request processed in 309us (401us total) trans 12884904337 rc 0/0 00000100:00100000:3.0:1789892540.634740:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2792 00000100:00100000:3.0:1789892541.218621:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915870720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892541.218621:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892541.218684:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.218722:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870720 00000100:00100000:0.0:1789892541.218730:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870720 00000100:00100000:0.0:1789892541.218782:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789892541.218792:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915870720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789892541.218825:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789892541.218882:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915870720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892541.218888:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789892541.218912:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915870720:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1789892541.355147:0:214769:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6cfe4350 20000000:00000080:1.0:1789892541.355160:0:214769:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90698779a800 uarg=0000000000000000 20000000:01000000:1.0:1789892541.355194:0:214769:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789892541.355196:0:214769:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789892541.355198:0:214769:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=ugp' 20000000:01000000:1.0:1789892541.355202:0:214769:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'quota.ost=ugp' 20000000:01000000:1.0:1789892541.355205:0:214769:0:(mgs_llog.c:4246:mgs_write_log_quota()) global 'quota.ost=ugp' 20000000:01000000:1.0:1789892541.355254:0:214769:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789892541.355260:0:214769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892541.355581:0:214770:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 32 marker 135 1->4: lustre quota.ost 20000000:01000000:2.0:1789892541.355639:0:214770:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 34 marker 135 2->4: lustre quota.ost 00000040:00080000:2.0:1789892541.355653:0:214770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 35 count 35 00000040:00080000:1.0:1789892541.355792:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14456 00000040:00080000:1.0:1789892541.355810:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 88 off14544 00000040:00080000:1.0:1789892541.355819:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 224 off14768 20000000:01000000:1.0:1789892541.355829:0:214769:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789892541.355830:0:214769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892541.356042:0:214771:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 35 marker 136 1->4: lustre quota.ost 20000000:01000000:2.0:1789892541.356065:0:214771:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 136 2->4: lustre quota.ost 00000040:00080000:2.0:1789892541.356076:0:214771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 38 count 38 00000040:00080000:1.0:1789892541.356171:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14984 00000040:00080000:1.0:1789892541.356188:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 88 off15072 00000040:00080000:1.0:1789892541.356198:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15296 20000000:01000000:1.0:1789892541.356207:0:214769:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789892541.356209:0:214769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892541.356525:0:214772:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 148 marker 137 1->4: lustre quota.ost 20000000:01000000:2.0:1789892541.356548:0:214772:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 150 marker 137 2->4: lustre quota.ost 00000040:00080000:2.0:1789892541.356567:0:214772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 182 count 178 00000040:00080000:1.0:1789892541.356657:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].182, 224 off41408 00000040:00080000:1.0:1789892541.356673:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].183, 88 off41496 00000040:00080000:1.0:1789892541.356683:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].184, 224 off41720 20000000:01000000:1.0:1789892541.356694:0:214769:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789892541.356695:0:214769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892541.356905:0:214773:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 148 marker 138 1->4: lustre quota.ost 20000000:01000000:2.0:1789892541.356926:0:214773:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 150 marker 138 2->4: lustre quota.ost 00000040:00080000:2.0:1789892541.356945:0:214773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 182 count 178 00000040:00080000:1.0:1789892541.357031:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].182, 224 off41408 00000040:00080000:1.0:1789892541.357050:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].183, 88 off41496 00000040:00080000:1.0:1789892541.357060:0:214769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].184, 224 off41720 10000000:01000000:1.0:1789892541.357073:0:214769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892541.357088:0:214769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357104:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357110:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357116:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357121:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357130:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357135:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357139:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357144:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357148:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357153:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357157:0:214769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357162:0:214769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357194:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357204:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 23 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.357224:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915870848:0@lo:104: 00000100:00100000:1.0:1789892541.357297:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892541.357340:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892541.357341:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870848 00000100:00100000:3.0:1789892541.357351:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870848 00010000:00010000:1.0:1789892541.357351:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 23 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.357360:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915870976:0@lo:104: 00000100:00100000:1.0:1789892541.357382:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892541.357410:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915870976 00000100:00100000:3.0:1789892541.357413:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915870976 00000100:00100000:2.0:1789892541.357430:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00010000:00010000:1.0:1789892541.357433:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892541.357441:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00010000:00010000:1.0:1789892541.357444:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 23 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.357446:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915870848:12345-0@lo:104: 00000100:00100000:3.0:1789892541.357456:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915870976:12345-0@lo:104: 00000100:00100000:1.0:1789892541.357459:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871104:0@lo:104: 00010000:00010000:2.0:1789892541.357462:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357467:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.357510:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.357542:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871104 00000100:00100000:0.0:1789892541.357548:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871104 00010000:00010000:2.0:1789892541.357555:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892541.357561:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892541.357565:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915870848:12345-0@lo:104: Request processed in 124us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892541.357566:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892541.357571:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915870976:12345-0@lo:104: Request processed in 117us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892541.357581:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:1.0:1789892541.357584:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 23 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357590:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789892541.357601:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1789892541.357603:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915871104:12345-0@lo:104: 00000100:00100000:1.0:1789892541.357605:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871232:0@lo:104: 00010000:00010000:2.0:1789892541.357611:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892541.357615:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.357618:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357623:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892541.357632:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.357636:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892541.357643:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.357643:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892541.357652:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892541.357658:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357669:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.357670:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.357678:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892541.357681:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892541.357683:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357691:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214769:x1876834915871104:12345-0@lo:104: Request processed in 89us (199us total) trans 0 rc 0/0 10000000:00010000:2.0:1789892541.357694:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892541.357707:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892541.357708:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 10000000:01000000:2.0:1789892541.357717:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892541.357723:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 23 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.357734:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871360:0@lo:104: 00000100:00100000:0.0:1789892541.357736:0:189423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789892541.357747:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357749:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871232 00010000:00010000:2.0:1789892541.357750:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357754:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871232 00010000:00010000:3.0:1789892541.357761:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892541.357767:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892541.357771:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.357783:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871360 00010000:00010000:3.0:1789892541.357785:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.357787:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357788:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871360 00010000:00010000:1.0:1789892541.357802:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357804:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021328d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213294 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.357807:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021329b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002132a2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357816:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00010000:00010000:1.0:1789892541.357824:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 23 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357832:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892541.357833:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915871232:12345-0@lo:104: 00010000:00010000:2.0:1789892541.357834:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892541.357837:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.357839:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892541.357839:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d946a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871744:0@lo:104: 00010000:00010000:2.0:1789892541.357843:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892541.357850:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357851:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892541.357857:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.357870:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915871616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892541.357875:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892541.357885:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892541.357894:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892541.357901:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892541.357904:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892541.357907:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.357912:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915871232:12345-0@lo:104: Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892541.357919:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.357929:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:3.0:1789892541.357932:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.357932:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 23 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.357949:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892541.357957:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d946300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871872:0@lo:104: 00000100:00100000:2.0:1789892541.357959:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789892541.357967:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871744 00010000:00010000:3.0:1789892541.357970:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.357970:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915871488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892541.357978:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871744 00000100:00100000:1.0:1789892541.357987:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892541.357988:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021327f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213286 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358003:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892541.358004:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871872 00010000:00010000:3.0:1789892541.358006:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358008:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871872 00000100:00100000:2.0:1789892541.358015:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892541.358018:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358021:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892541.358027:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358027:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00010000:00010000:1.0:1789892541.358037:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 23 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358039:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358039:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915871360:12345-0@lo:104: 00010000:00010000:0.0:1789892541.358052:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358053:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871616 00000100:00100000:2.0:1789892541.358060:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871616 10000000:00010000:3.0:1789892541.358062:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.358068:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872128:0@lo:104: 10000000:01000000:3.0:1789892541.358074:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892541.358090:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 24 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358095:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.358101:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892541.358113:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915871360:12345-0@lo:104: Request processed in 73us (341us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892541.358118:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892541.358122:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.358128:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00010000:00010000:3.0:1789892541.358129:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358136:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213278 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358146:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915871488 00010000:00010000:3.0:1789892541.358149:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892541.358149:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915872128 00000100:00100000:2.0:1789892541.358151:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915871488 00010000:00010000:3.0:1789892541.358155:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358156:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915872128 00010000:00010000:1.0:1789892541.358158:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 25 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.358169:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 25 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358172:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892541.358176:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 10000000:00010000:3.0:1789892541.358180:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.358180:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 25 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358188:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915871744:12345-0@lo:104: 00010000:00010000:0.0:1789892541.358202:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358203:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358204:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789892541.358207:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d946680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872384:0@lo:104: 00000100:00100000:2.0:1789892541.358220:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915871616:12345-0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789892541.358226:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892541.358232:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892541.358235:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892541.358243:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 25 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.358244:0:214769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892541.358247:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358255:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892541.358260:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 25 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.358265:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892541.358285:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358293:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915871744:12345-0@lo:104: Request processed in 105us (419us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892541.358295:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021326a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.358297:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892541.358302:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358304:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00010000:00010000:3.0:1789892541.358320:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892541.358323:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 9 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358323:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915872384 00010000:00010000:3.0:1789892541.358325:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358327:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915872384 00000100:00100000:2.0:1789892541.358334:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915871616:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892541.358343:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00010000:00010000:3.0:1789892541.358345:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892541.358350:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358352:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789892541.358352:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872640:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892541.358355:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915871872:12345-0@lo:104: 00010000:00010000:0.0:1789892541.358369:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358370:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358379:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 10000000:00010000:3.0:1789892541.358389:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358394:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915871488:12345-0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789892541.358411:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892541.358413:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892541.358417:0:214769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.358419:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 24 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.358428:0:214769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 9 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358430:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.358439:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892541.358446:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892541.358448:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:214769:x1876834915871872:12345-0@lo:104: Request processed in 95us (464us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892541.358450:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 24 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.358450:0:214769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872768:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892541.358454:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358462:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00010000:00010000:3.0:1789892541.358475:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd00213255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021325c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.358481:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892541.358482:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1789892541.358484:0:214769:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00010000:00010000:3.0:1789892541.358512:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892541.358516:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358521:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffa00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892541.358525:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915872128:12345-0@lo:104: 10000000:00010000:3.0:1789892541.358526:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.358533:0:214769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd002132a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021329b expref: 24 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.358543:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358545:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358552:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3622:x1876834915871488:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892541.358555:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915870848:0@lo:104: 10000000:00010000:3.0:1789892541.358569:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358573:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00010000:00010000:1.0:1789892541.358573:0:214769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837a00/0x5c4f93dd00213294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021328d expref: 23 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892541.358579:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892541.358593:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915870976:0@lo:104: 00010000:00010000:3.0:1789892541.358597:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358603:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892541.358608:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.358613:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871104:0@lo:104: 00010000:00010000:0.0:1789892541.358613:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892541.358614:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021324e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358626:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915872256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892541.358628:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:214769:x1876834915872128:12345-0@lo:104: Request processed in 134us (508us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892541.358633:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892541.358634:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871232:0@lo:104: 00010000:00010000:3.0:1789892541.358639:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358648:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1789892541.358652:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871360:0@lo:104: 00000100:00100000:2.0:1789892541.358666:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.358667:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00010000:00010000:3.0:1789892541.358668:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffec00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892541.358674:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d946a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871744:0@lo:104: 10000000:00010000:3.0:1789892541.358675:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358680:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214769:x1876834915872384:12345-0@lo:104: 00000100:00100000:1.0:1789892541.358692:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d946300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915871872:0@lo:104: 00010000:00010000:0.0:1789892541.358695:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358696:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358702:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789892541.358702:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872128:0@lo:104: 00000100:00100000:2.0:1789892541.358712:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915872000:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789892541.358720:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892541.358724:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892541.358748:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358753:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892541.358757:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892541.358761:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358762:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.358769:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:214769:x1876834915872384:12345-0@lo:104: Request processed in 90us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892541.358774:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d946680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872384:0@lo:104: 00010000:00010000:3.0:1789892541.358775:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213240 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358785:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789892541.358791:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915873024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892541.358795:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892541.358799:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358803:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836400 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892541.358806:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.358811:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892541.358821:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358828:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915872512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892541.358830:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789892541.358836:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892541.358841:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892541.358863:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.358866:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915873152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892541.358870:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915872256 00000100:00100000:0.0:1789892541.358873:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892541.358876:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915872256 00010000:00010000:3.0:1789892541.358879:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892541.358892:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.358900:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 22 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.358903:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd0021322b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213232 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358909:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915873280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892541.358914:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892541.358928:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915872000 00000100:00100000:1.0:1789892541.358933:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915872000 00010000:00010000:3.0:1789892541.358936:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892541.358941:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892541.358946:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892541.358948:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 23 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892541.358950:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892541.358969:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873024 00000100:00100000:3.0:1789892541.358970:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915872512 00000100:00100000:0.0:1789892541.358970:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789892541.358972:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873152 00000100:00100000:2.0:1789892541.358974:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873024 00000100:00100000:3.0:1789892541.358978:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915872512 00000100:00100000:1.0:1789892541.358979:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873152 00000100:00100000:0.0:1789892541.358980:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915872896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892541.358991:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 26 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.359003:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 26 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.359006:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 26 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.359009:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873280 00000100:00100000:0.0:1789892541.359011:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892541.359014:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873280 00010000:00010000:2.0:1789892541.359031:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 27 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892541.359037:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915872896 00010000:00010000:0.0:1789892541.359039:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892541.359042:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915872896 00000100:00100000:1.0:1789892541.359044:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789892541.359051:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1789892541.359055:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3620:x1876834915872256:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892541.359060:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00010000:00010000:3.0:1789892541.359061:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 28 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.359062:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3620:x1876834915872000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892541.359066:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892541.359074:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc397450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3620:x1876834915873024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892541.359078:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892541.359081:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 28 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359085:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892541.359086:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 28 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359095:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 28 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.359111:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 28 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892541.359112:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1789892541.359123:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3621:x1876834915872512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892541.359128:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 28 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.359132:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892541.359138:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 28 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.359146:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213271 expref: 28 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.359147:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 28 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359164:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd0021324e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213247 expref: 27 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.359166:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 27 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.359186:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892541.359187:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e800/0x5c4f93dd00213286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021327f expref: 26 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359192:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892541.359193:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837e00/0x5c4f93dd0021326a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213263 expref: 26 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.359211:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892541.359212:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892541.359237:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3620:x1876834915872256:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892541.359241:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc397450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3620:x1876834915873024:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892541.359256:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789892541.359258:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3620:x1876834915872000:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892541.359268:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915872512:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892541.359293:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1789892541.359308:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789892541.359315:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1789892541.359322:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1789892541.359330:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1789892541.359335:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3620:x1876834915873152:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892541.359341:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789892541.359344:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3621:x1876834915873280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892541.359350:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892541.359354:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892541.359356:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3621:x1876834915872896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892541.359360:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 20 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359361:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 20 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.359367:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892541.359376:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 20 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.359393:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 20 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892541.359410:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 20 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359420:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 20 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.359425:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915872000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892541.359435:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f400/0x5c4f93dd00213240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213239 expref: 20 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.359438:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915873024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892541.359441:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021325c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213255 expref: 20 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892541.359445:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff600/0x5c4f93dd00213232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021322b expref: 19 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.359448:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892541.359449:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915872256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892541.359468:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892541.359473:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892541.359482:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3620:x1876834915873152:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892541.359486:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915873152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892541.359517:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1789892541.359536:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915873280:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892541.359542:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915872896:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892541.359546:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1789892541.359555:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00010000:00010000:0.0:1789892541.359571:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892541.359593:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915872896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892541.359606:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915873280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892541.359614:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915872512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892541.359631:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892541.359666:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915871488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892541.359677:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915871616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892541.360785:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872640:192.168.204.33@tcp:104: 00000100:00100000:1.0:1789892541.360800:0:214769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214769:1876834915872768:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892541.360828:0:214769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892541.361032:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892541.361066:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848448 00000100:00100000:2.0:1789892541.361072:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848448 00000100:00100000:3.0:1789892541.361090:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1789892541.361097:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 10 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.361132:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848320 00000100:00100000:1.0:1789892541.361137:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848320 00000100:00100000:2.0:1789892541.361144:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 471 00010000:00010000:1.0:1789892541.361156:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 11 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.361157:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925848448:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892541.361172:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892541.361180:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 11 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.361188:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 472 00000100:00100000:1.0:1789892541.361198:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925848320:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892541.361211:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892541.361218:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 11 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.361218:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 11 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.361241:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 11 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361255:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837400/0x5c4f93dd00213224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c7 expref: 11 pid: 189434 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.361262:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e600/0x5c4f93dd0021321d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5c0 expref: 11 pid: 189432 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361267:0:189424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361289:0:189424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.361296:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892541.361301:0:189424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361308:0:189424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361314:0:189424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361319:0:189424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361324:0:189424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800400 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:2.0:1789892541.361329:0:189424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.361329:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2399:x1876834925848320:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 132us (237us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892541.361344:0:189424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892541.361344:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 472 00010000:00010000:2.0:1789892541.361375:0:189424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.361382:0:214769:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892541.361387:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892541.361389:0:214769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892541.361401:0:214769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800400/0x5c4f93dd00213366 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892541.361429:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925848448:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 274us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892541.361439:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 471 00000100:00100000:0.0:1789892541.730653:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915873408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892541.730719:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892541.730799:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873408 00000100:00100000:0.0:1789892541.730808:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873408 00000100:00100000:0.0:1789892541.730867:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789892541.730889:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915873408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789892541.730923:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00000100:00100000:0.0:1789892541.730968:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915873408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892541.730975:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789892541.731009:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915873408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789892542.242600:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892542.242601:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915873536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892542.242629:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915873664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892542.242630:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915873920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892542.242631:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915873792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892542.242668:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892542.242695:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892542.242727:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873536 00000100:00100000:3.0:1789892542.242734:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873536 00000100:00100000:2.0:1789892542.242752:0:190946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873792 00000100:00100000:2.0:1789892542.242759:0:190946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873792 00000100:00080000:0.0:1789892542.242767:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789892542.242773:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892542.242790:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873920 00000100:00100000:3.0:1789892542.242794:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873920 00000100:00100000:2.0:1789892542.242812:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789892542.242825:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915873536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892542.242830:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789892542.242842:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789892542.242843:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915873792:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789892542.242851:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789892542.242856:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892542.242856:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915873920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789892542.242858:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892542.242876:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789892542.242882:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892542.242924:0:190947:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 4 min 2 max 16 00000100:00100000:0.0:1789892542.242932:0:190947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_004' 00000100:00100000:2.0:1789892542.242935:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915873536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892542.242936:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915873792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892542.242937:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915873920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892542.242954:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789892542.242965:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789892542.242975:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789892542.242975:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915873664 00000100:00100000:1.0:1789892542.242981:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915873664 00000100:00100000:1.0:1789892542.243020:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789892542.243024:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915873536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892542.243026:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915873792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892542.243029:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915873664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789892542.243043:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789892542.243065:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892542.243076:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915873664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892542.243083:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789892542.243124:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915873664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892542.243132:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915873920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892542.243601:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915874048:0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.243639:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.243667:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915874304:0@lo:400:kworker.0 00000100:00100000:0.0:1789892542.243673:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874048 00000100:00100000:0.0:1789892542.243678:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874048 00000100:00100000:1.0:1789892542.243699:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915874560:0@lo:400:kworker.0 00000100:00100000:0.0:1789892542.243713:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1789892542.243719:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892542.243727:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3619:x1876834915874048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.243739:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915874432:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.243759:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1876834915874816:0@lo:400:kworker.0 00000100:00100000:0.0:1789892542.243775:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3619:x1876834915874048:12345-0@lo:400:kworker.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892542.243781:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:1.0:1789892542.243787:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.243805:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892542.243819:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069a5e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1876834915874944:0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.243849:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.243866:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874304 00000100:00100000:2.0:1789892542.243871:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874304 00000100:00100000:1.0:1789892542.243895:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874432 00000100:00100000:1.0:1789892542.243899:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874432 00000100:00100000:2.0:1789892542.243910:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874816 00000100:00100000:2.0:1789892542.243916:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874816 00000100:00100000:1.0:1789892542.243939:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892542.243949:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915874432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.243964:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874944 00000100:00100000:2.0:1789892542.243968:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874944 00000100:00100000:1.0:1789892542.243992:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915874432:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892542.243999:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789892542.244002:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1789892542.244012:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915874304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244026:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789892542.244036:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876834915874816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244065:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915874304:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892542.244072:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789892542.244081:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876834915874816:12345-0@lo:400:kworker.0 Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892542.244089:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1789892542.244096:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1789892542.244110:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3622:x1876834915874944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244124:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915874432:0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244154:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.244168:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3622:x1876834915874944:12345-0@lo:400:kworker.0 Request processed in 63us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892542.244175:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789892542.244181:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915875072:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244194:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874560 00000100:00100000:2.0:1789892542.244198:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874560 00000100:00100000:1.0:1789892542.244211:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.244222:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875072 00000100:00100000:2.0:1789892542.244225:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875072 00000100:00100000:1.0:1789892542.244235:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915874048:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244247:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789892542.244251:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789892542.244272:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915874560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244275:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915874176:0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244314:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.244319:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915874560:12345-0@lo:400:kworker.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892542.244325:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789892542.244339:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915874688:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244343:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789892542.244351:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915875072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244381:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892542.244389:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915875072:12345-0@lo:400:kworker.0 Request processed in 40us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892542.244401:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789892542.244415:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915874560:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244423:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874688 00000100:00100000:2.0:1789892542.244429:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874688 00010000:00080000:1.0:1789892542.244430:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90689d2ead80 x1876834915875072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892542.244441:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915875072:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244463:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789892542.244474:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915874688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244475:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915874176 00000100:00100000:1.0:1789892542.244480:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915874176 00000100:00100000:1.0:1789892542.244538:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789892542.244551:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915874688:12345-0@lo:400:kworker.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892542.244551:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915874176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244563:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00080000:2.0:1789892542.244596:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892542.244600:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915874176:12345-0@lo:400:kworker.0 Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00080000:2.0:1789892542.244602:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892542.244609:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789892542.244634:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915874304:0@lo:400:kworker.0 00010000:00080000:2.0:1789892542.244653:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906885ebfb80 x1876834915874816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892542.244662:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069a5e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1876834915874944:0@lo:400:kworker.0 00000100:00100000:2.0:1789892542.244664:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1876834915874816:0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244707:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915874176:0@lo:400:kworker.0 00000100:00100000:1.0:1789892542.244722:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915874688:0@lo:400:kworker.0 00000001:02000400:3.0:1789892543.003101:0:215015:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: User quota (block hardlimit:1000 MB) 00000100:00100000:3.0:1789892543.050189:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892543.050249:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848576 00000100:00100000:0.0:1789892543.050260:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848576 00000100:00080000:1.0:1789892543.050334:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892543.050355:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2793 00000100:00100000:0.0:1789892543.050370:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+10:213845:x1876834925848576:12345-192.168.204.33@tcp:48:lfs.0 00000001:00080000:2.0:1789892543.051859:0:189419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904337 is committed 00010000:00010000:2.0:1789892543.051896:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051905:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051912:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051917:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837c00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892543.051921:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051936:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051952:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff90698683a300) 00010000:00010000:2.0:1789892543.051954:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892543.051958:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051963:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837c00/0x5c4f93dd00213327 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051982:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051986:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051991:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.051995:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836600 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892543.051998:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052002:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052008:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90698683a000) 00010000:00010000:2.0:1789892543.052010:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892543.052012:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052023:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836600/0x5c4f93dd0021332e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052037:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052041:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052046:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052050:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ec00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892543.052052:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052057:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052064:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90698683a000) 00010000:00010000:2.0:1789892543.052066:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789892543.052068:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.052072:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878ec00/0x5c4f93dd0021335f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.053721:0:189439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875200:0@lo:106: 00000100:00100000:0.0:1789892543.053777:0:189439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892543.053846:0:189439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875328:0@lo:106: 00000100:00100000:0.0:1789892543.053876:0:189439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892543.053917:0:189439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875456:0@lo:106: 00000100:00100000:0.0:1789892543.053952:0:189439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875584:0@lo:106: 00000100:00100000:0.0:1789892543.053972:0:189439:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892543.053999:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875200 00000100:00100000:0.0:1789892543.054004:0:189423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789892543.054017:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875200 00000100:00100000:0.0:1789892543.054035:0:189423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892543.054061:0:189423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.054062:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875328 00000100:00100000:2.0:1789892543.054068:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875328 00000100:00100000:0.0:1789892543.054079:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875456 00000100:00100000:0.0:1789892543.054091:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875456 00000100:00100000:2.0:1789892543.054101:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875584 00000100:00100000:2.0:1789892543.054107:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875584 00000100:00100000:0.0:1789892543.054127:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789892543.054139:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:189439:x1876834915875200:12345-0@lo:106: 00000100:00100000:2.0:1789892543.054146:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00010000:00010000:0.0:1789892543.054151:0:189423:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.054162:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068824e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:189439:x1876834915875328:12345-0@lo:106: 00010000:00010000:0.0:1789892543.054165:0:189423:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.054168:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00010000:00010000:2.0:1789892543.054178:0:189422:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.054183:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-MDT0001+9:189439:x1876834915875456:12345-0@lo:106: 00010000:00010000:2.0:1789892543.054195:0:189422:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.054196:0:193633:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.054224:0:193633:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.054263:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:189439:x1876834915875200:12345-0@lo:106: Request processed in 127us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.054274:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789892543.054299:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1789892543.054308:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-lwp-MDT0001+9:189439:x1876834915875456:12345-0@lo:106: Request processed in 127us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892543.054308:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068824e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:189439:x1876834915875328:12345-0@lo:106: Request processed in 148us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.054315:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:189439:x1876834915875584:12345-0@lo:106: 00000100:00100000:3.0:1789892543.054325:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:0.0:1789892543.054331:0:189423:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.054337:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00010000:00010000:0.0:1789892543.054347:0:189423:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.054403:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:189439:x1876834915875584:12345-0@lo:106: Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.054410:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789892543.054700:0:189439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875200:0@lo:106: 00000100:00100000:0.0:1789892543.054723:0:189439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875328:0@lo:106: 00000100:00100000:0.0:1789892543.054737:0:189439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875456:0@lo:106: 00000100:00100000:0.0:1789892543.054747:0:189439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:189439:1876834915875584:0@lo:106: 00000100:00100000:0.0:1789892543.054848:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:213845:x1876834925848576:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 4482us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.054857:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2793 00000100:00100000:3.0:1789892543.119135:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892543.119176:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848704 00000100:00100000:0.0:1789892543.119186:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848704 00000100:00100000:0.0:1789892543.119246:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1986 00000100:00100000:0.0:1789892543.119259:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925848704:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.119287:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.119306:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a5ff expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.119331:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.119340:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.119348:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892543.119396:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925848704:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.119402:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1986 00000100:00100000:3.0:1789892543.120292:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892543.120336:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848832 00000100:00100000:0.0:1789892543.120341:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848832 00000100:00100000:0.0:1789892543.120372:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1987 00000100:00100000:0.0:1789892543.120378:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925848832:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.120482:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925848832:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.120519:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1987 00000100:00100000:3.0:1789892543.121180:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892543.121215:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925848960 00000100:00100000:0.0:1789892543.121221:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925848960 00000100:00100000:0.0:1789892543.121266:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1988 00000100:00100000:0.0:1789892543.121276:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925848960:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.121359:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925848960:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 85us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.121365:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1988 00000100:00100000:3.0:1789892543.123203:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892543.123285:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849088 00000100:00100000:0.0:1789892543.123290:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849088 00000100:00100000:0.0:1789892543.123319:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1989 00000100:00100000:0.0:1789892543.123327:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925849088:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.123335:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.123345:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a606 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.123360:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.123368:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.123373:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837800, rc 0) 00000100:00100000:0.0:1789892543.123399:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925849088:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.123404:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1989 00000100:00100000:3.0:1789892543.124075:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892543.124136:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849216 00000100:00100000:0.0:1789892543.124141:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849216 00000100:00100000:0.0:1789892543.124171:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 1990 00000100:00100000:0.0:1789892543.124178:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925849216:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.124226:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925849216:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 48us (153us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892543.124232:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 1990 00010000:00010000:3.0:1789892543.266585:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892543.266612:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892543.266617:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 159 10000000:01000000:1.0:1789892543.266621:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892543.266655:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.266665:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.266674:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.266701:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915875712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.266778:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.266810:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.266824:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875712 00000100:00100000:0.0:1789892543.266833:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875712 00000100:00100000:0.0:1789892543.266886:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:0.0:1789892543.266897:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915875712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.266912:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.266928:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021337b expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.266955:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.266968:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.266979:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836600, rc 0) 00000100:00100000:0.0:1789892543.267028:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915875712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.267038:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1789892543.267053:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915875712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892543.267068:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.267077:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.267126:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915875840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.267149:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.267165:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.267188:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875840 00000100:00100000:0.0:1789892543.267194:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875840 00000100:00100000:0.0:1789892543.267222:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1789892543.267253:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915875840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.267369:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915875840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.267379:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1789892543.267397:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915875840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.267429:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915875968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.267464:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.267479:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.267532:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915875968 00000100:00100000:0.0:1789892543.267537:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915875968 00000100:00100000:0.0:1789892543.267568:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1789892543.267576:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915875968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.267666:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915875968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.267669:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915875968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.267682:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000040:00080000:0.0:1789892543.268526:0:215045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:1.0:1789892543.268584:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:1.0:1789892543.268614:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892543.268620:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.268627:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892543.268639:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892543.268640:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789892543.268642:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892543.268653:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.268658:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.268664:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.268672:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.268692:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.268710:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.268730:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876096 00000100:00100000:0.0:1789892543.268736:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876096 00000100:00100000:0.0:1789892543.268767:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:0.0:1789892543.268777:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915876096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.268785:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.268795:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213389 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.268811:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.268821:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.268829:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837c00, rc 0) 00000100:00100000:0.0:1789892543.268873:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915876096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.268878:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.268886:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00010000:00010000:1.0:1789892543.268890:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.268897:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.268927:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.268945:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.268956:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.268967:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876224 00000100:00100000:0.0:1789892543.268973:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876224 00000100:00100000:0.0:1789892543.269003:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1789892543.269012:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915876224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.269094:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915876224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.269097:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.269111:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1789892543.269134:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.269161:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.269173:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.269184:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876352 00000100:00100000:0.0:1789892543.269190:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876352 00000100:00100000:0.0:1789892543.269219:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:0.0:1789892543.269229:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915876352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.269321:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915876352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.269329:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1789892543.269332:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.269573:0:215046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215046:1876834915876480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892543.269600:0:215046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.269618:0:215046:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.269627:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876480 00000100:00100000:0.0:1789892543.269633:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876480 00000100:00100000:0.0:1789892543.269664:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:0.0:1789892543.269674:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:215046:x1876834915876480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.269762:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:215046:x1876834915876480:12345-0@lo:502:llog_process_th.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.269766:0:215046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215046:1876834915876480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.269778:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000020:01000000:1.0:1789892543.269790:0:215046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892543.269798:0:215046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892543.269800:0:215046:0:(obd_config.c:1561:class_process_config()) marker 169 (0x1) lustre quota.ost 00000020:00000080:1.0:1789892543.269805:0:215046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789892543.269822:0:215046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215046:1876834915876608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892543.269847:0:215046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.269859:0:215046:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699b385a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.269870:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876608 00000100:00100000:0.0:1789892543.269875:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876608 00000100:00100000:0.0:1789892543.269904:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:0.0:1789892543.269921:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:215046:x1876834915876608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.269998:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:215046:x1876834915876608:12345-0@lo:502:llog_process_th.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.270001:0:215046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215046:1876834915876608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.270015:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000020:01000000:1.0:1789892543.270023:0:215046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892543.270027:0:215046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892543.270028:0:215046:0:(obd_config.c:1561:class_process_config()) marker 169 (0x2) lustre quota.ost 00000040:00080000:1.0:1789892543.270031:0:215046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 38 00000020:01000000:2.0:1789892543.270122:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-37 (rc=0) 10000000:01000000:2.0:1789892543.270139:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892543.270145:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.270152:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.270158:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892543.270159:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 159 10000000:01000000:2.0:1789892543.270161:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892543.270175:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.270180:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.270194:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.270205:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.270250:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.270268:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.270288:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876736 00000100:00100000:0.0:1789892543.270294:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876736 00000100:00100000:0.0:1789892543.270323:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1789892543.270332:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915876736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.270340:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.270349:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213397 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.270366:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.270375:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.270383:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837000, rc 0) 00000100:00100000:0.0:1789892543.270421:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915876736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.270430:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1789892543.270449:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.270460:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.270466:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.270526:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.270555:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.270572:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.270579:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876864 00000100:00100000:0.0:1789892543.270584:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876864 00000100:00100000:0.0:1789892543.270613:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:0.0:1789892543.270621:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915876864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.270691:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915876864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.270706:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1789892543.270710:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.270735:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.270763:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.270776:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.270786:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915876992 00000100:00100000:0.0:1789892543.270791:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915876992 00000100:00100000:0.0:1789892543.270829:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1789892543.270838:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915876992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.270921:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915876992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.270930:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1789892543.270932:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915876992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892543.271797:0:215047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:2.0:1789892543.271890:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:2.0:1789892543.271907:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892543.271911:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.271924:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.271930:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892543.271931:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:2.0:1789892543.271933:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892543.271944:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.271950:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.271955:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.271965:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.271987:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.272007:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.272026:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877120 00000100:00100000:0.0:1789892543.272031:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877120 00000100:00100000:0.0:1789892543.272058:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1789892543.272065:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915877120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.272072:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.272080:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002133a5 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.272094:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.272105:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.272114:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836400, rc 0) 00000100:00100000:0.0:1789892543.272147:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915877120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.272154:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1789892543.272175:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.272186:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.272192:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.272217:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.272249:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.272269:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.272274:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877248 00000100:00100000:0.0:1789892543.272285:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877248 00000100:00100000:0.0:1789892543.272306:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1789892543.272310:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915877248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.272365:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915877248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.272371:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1789892543.272393:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.272413:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.272440:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.272454:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.272463:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877376 00000100:00100000:0.0:1789892543.272467:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877376 00000100:00100000:0.0:1789892543.272487:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1789892543.272512:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915877376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.272578:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915877376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.272583:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1789892543.272599:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.272801:0:215048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215048:1876834915877504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.272850:0:215048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.272880:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877504 00000100:00100000:0.0:1789892543.272894:0:215048:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892543.272897:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877504 00000100:00100000:2.0:1789892543.272923:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1789892543.272929:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:215048:x1876834915877504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892543.272993:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:215048:x1876834915877504:12345-0@lo:502:llog_process_th.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892543.272999:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1789892543.273025:0:215048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215048:1876834915877504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892543.273053:0:215048:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892543.273059:0:215048:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892543.273061:0:215048:0:(obd_config.c:1561:class_process_config()) marker 170 (0x1) lustre quota.ost 00000020:00000080:0.0:1789892543.273067:0:215048:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789892543.273099:0:215048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215048:1876834915877632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.273150:0:215048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892543.273173:0:215048:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.273191:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877632 00000100:00100000:3.0:1789892543.273196:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877632 00000100:00100000:3.0:1789892543.273231:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1789892543.273251:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:215048:x1876834915877632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892543.273330:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:215048:x1876834915877632:12345-0@lo:502:llog_process_th.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.273337:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1789892543.273350:0:215048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215048:1876834915877632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892543.273384:0:215048:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892543.273388:0:215048:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892543.273390:0:215048:0:(obd_config.c:1561:class_process_config()) marker 170 (0x2) lustre quota.ost 00000040:00080000:0.0:1789892543.273395:0:215048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 41 count 41 00000020:01000000:2.0:1789892543.273452:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-40 (rc=0) 10000000:01000000:2.0:1789892543.273469:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892543.273482:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.273503:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.273510:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892543.273512:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 159 10000000:01000000:2.0:1789892543.273514:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892543.273525:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.273530:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.273541:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.273550:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.273570:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.273589:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.273597:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877760 00000100:00100000:0.0:1789892543.273602:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877760 00000100:00100000:0.0:1789892543.273632:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1789892543.273641:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915877760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.273649:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.273659:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002133b3 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.273674:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.273683:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.273691:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837e00, rc 0) 00000100:00100000:0.0:1789892543.273728:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915877760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.273735:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1789892543.273758:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.273767:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.273774:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.273799:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.273825:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.273838:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.273860:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915877888 00000100:00100000:3.0:1789892543.273865:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915877888 00000100:00100000:3.0:1789892543.273892:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:3.0:1789892543.273901:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915877888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892543.273977:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915877888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.273984:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1789892543.273995:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915877888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.274015:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.274040:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.274053:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.274079:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878016 00000100:00100000:0.0:1789892543.274084:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878016 00000100:00100000:0.0:1789892543.274116:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:0.0:1789892543.274126:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915878016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.274215:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915878016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892543.274227:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.274256:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000040:00080000:0.0:1789892543.275093:0:215049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:2.0:1789892543.275187:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:2.0:1789892543.275200:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892543.275205:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.275218:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.275224:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892543.275225:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 182 10000000:01000000:2.0:1789892543.275227:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892543.275254:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.275260:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.275266:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.275276:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.275298:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.275330:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.275356:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878144 00000100:00100000:3.0:1789892543.275362:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878144 00000100:00100000:3.0:1789892543.275388:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1789892543.275393:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915878144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892543.275400:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892543.275417:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002133c1 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.275430:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.275438:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.275446:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f800, rc 0) 00000100:00100000:3.0:1789892543.275487:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915878144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.275517:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1789892543.275521:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.275533:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.275539:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.275567:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.275586:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.275610:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.275627:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878272 00000100:00100000:0.0:1789892543.275633:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878272 00000100:00100000:0.0:1789892543.275663:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1789892543.275672:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915878272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.275753:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915878272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892543.275762:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.275763:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1789892543.275790:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.275818:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.275832:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.275855:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878400 00000100:00100000:3.0:1789892543.275859:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878400 00000100:00100000:3.0:1789892543.275883:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:3.0:1789892543.275892:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915878400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892543.275969:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915878400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.275976:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1789892543.275983:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.276158:0:215050:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215050:1876834915878528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892543.276195:0:215050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.276214:0:215050:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699b385a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.276282:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878528 00000100:00100000:0.0:1789892543.276287:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878528 00000100:00100000:0.0:1789892543.276314:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:0.0:1789892543.276319:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215050:x1876834915878528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.276395:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215050:x1876834915878528:12345-0@lo:502:llog_process_th.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.276401:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1789892543.276423:0:215050:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215050:1876834915878528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892543.276442:0:215050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892543.276451:0:215050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892543.276452:0:215050:0:(obd_config.c:1561:class_process_config()) marker 171 (0x1) lustre quota.ost 00000020:00000080:1.0:1789892543.276466:0:215050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789892543.276480:0:215050:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215050:1876834915878656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892543.276535:0:215050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.276557:0:215050:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699b173cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.276569:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878656 00000100:00100000:3.0:1789892543.276573:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878656 00000100:00100000:3.0:1789892543.276596:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:3.0:1789892543.276601:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215050:x1876834915878656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892543.276669:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215050:x1876834915878656:12345-0@lo:502:llog_process_th.0 Request processed in 65us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.276671:0:215050:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215050:1876834915878656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892543.276685:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000020:01000000:1.0:1789892543.276694:0:215050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892543.276698:0:215050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892543.276699:0:215050:0:(obd_config.c:1561:class_process_config()) marker 171 (0x2) lustre quota.ost 00000040:00080000:1.0:1789892543.276703:0:215050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 185 count 181 00000020:01000000:2.0:1789892543.276757:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 182-184 (rc=0) 10000000:01000000:2.0:1789892543.276774:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892543.276778:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.276784:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.276789:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892543.276790:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 159 10000000:01000000:2.0:1789892543.276792:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892543.276802:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.276807:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.276812:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.276820:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.276839:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.276860:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.276891:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878784 00000100:00100000:0.0:1789892543.276896:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878784 00000100:00100000:0.0:1789892543.276927:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:0.0:1789892543.276936:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915878784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.276945:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.276954:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002133cf expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.276971:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.276993:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.277001:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837400, rc 0) 00000100:00100000:0.0:1789892543.277040:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915878784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.277049:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1789892543.277054:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.277065:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.277072:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.277096:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.277113:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.277126:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.277161:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915878912 00000100:00100000:3.0:1789892543.277175:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915878912 00000100:00100000:3.0:1789892543.277208:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:3.0:1789892543.277219:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915878912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892543.277294:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915878912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.277301:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1789892543.277312:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915878912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.277333:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.277358:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.277371:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.277396:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879040 00000100:00100000:0.0:1789892543.277402:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879040 00000100:00100000:0.0:1789892543.277432:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1789892543.277441:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915879040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.277564:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915879040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.277574:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1789892543.277577:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892543.278393:0:215051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:2.0:1789892543.278452:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:2.0:1789892543.278471:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892543.278476:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.278483:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.278511:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892543.278513:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 182 10000000:01000000:2.0:1789892543.278515:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892543.278534:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.278539:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.278545:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.278554:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.278577:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.278598:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.278622:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879168 00000100:00100000:3.0:1789892543.278626:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879168 00000100:00100000:3.0:1789892543.278652:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1789892543.278660:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915879168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892543.278668:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892543.278677:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002133dd expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.278701:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.278725:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.278730:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f200, rc 0) 00000100:00100000:3.0:1789892543.278766:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915879168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.278773:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1789892543.278795:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.278806:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.278812:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.278839:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.278858:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.278872:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.278896:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879296 00000100:00100000:0.0:1789892543.278902:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879296 00000100:00100000:0.0:1789892543.278933:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1789892543.278943:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915879296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892543.279024:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915879296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.279033:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1789892543.279036:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.279061:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.279088:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.279101:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.279132:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879424 00000100:00100000:3.0:1789892543.279136:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879424 00000100:00100000:3.0:1789892543.279157:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:3.0:1789892543.279162:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915879424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892543.279227:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915879424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.279246:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1789892543.279261:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892543.279464:0:215052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215052:1876834915879552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892543.279517:0:215052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.279540:0:215052:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699b173cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.279560:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879552 00000100:00100000:0.0:1789892543.279566:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879552 00000100:00100000:0.0:1789892543.279595:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:0.0:1789892543.279604:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215052:x1876834915879552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.279701:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215052:x1876834915879552:12345-0@lo:502:llog_process_th.0 Request processed in 97us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.279718:0:215052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215052:1876834915879552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892543.279719:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000020:01000000:1.0:1789892543.279750:0:215052:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892543.279754:0:215052:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892543.279756:0:215052:0:(obd_config.c:1561:class_process_config()) marker 172 (0x1) lustre quota.ost 00000020:00000080:1.0:1789892543.279759:0:215052:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789892543.279773:0:215052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215052:1876834915879680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892543.279798:0:215052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.279812:0:215052:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699156f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.279834:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879680 00000100:00100000:3.0:1789892543.279838:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879680 00000100:00100000:3.0:1789892543.279860:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1789892543.279867:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215052:x1876834915879680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892543.279952:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215052:x1876834915879680:12345-0@lo:502:llog_process_th.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.279957:0:215052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215052:1876834915879680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892543.279959:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000020:01000000:1.0:1789892543.279981:0:215052:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892543.279985:0:215052:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892543.279987:0:215052:0:(obd_config.c:1561:class_process_config()) marker 172 (0x2) lustre quota.ost 00000040:00080000:1.0:1789892543.279990:0:215052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 185 count 181 00000020:01000000:2.0:1789892543.280045:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 182-184 (rc=0) 10000000:01000000:2.0:1789892543.280059:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892543.280064:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.280070:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892543.280075:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892543.280077:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892543.280078:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892543.280089:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.280094:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.280100:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.280108:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.280135:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.280150:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892543.280174:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879808 00000100:00100000:0.0:1789892543.280180:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879808 00000100:00100000:0.0:1789892543.280211:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:0.0:1789892543.280220:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915879808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892543.280228:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892543.280252:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002133eb expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.280269:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.280286:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.280293:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892543.280331:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915879808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.280339:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:2.0:1789892543.280352:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892543.280363:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.280369:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.280404:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892543.280428:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892543.280441:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892543.280467:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915879936 00000100:00100000:3.0:1789892543.280473:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915879936 00000100:00100000:3.0:1789892543.280518:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1789892543.280525:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915879936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892543.280576:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915879936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892543.280582:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1789892543.280588:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915879936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892543.280610:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892543.280614:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.280620:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789892543.352645:0:215071:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff59bb73d0 20000000:00000080:2.0:1789892543.352658:0:215071:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9069af2c7000 uarg=0000000000000000 00000040:00100000:2.0:1789892543.353125:0:215071:0:(llog.c:1072:llog_reverse_process()) index 158 : idx 137 20000000:01000000:2.0:1789892543.353130:0:215071:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 151 cmd:0xce023 lustre.qpool1 00000040:00080000:2.0:1789892543.353194:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].159, 224 off37176 20000000:01000000:2.0:1789892543.353209:0:215071:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789892543.353218:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].160, 104 off37280 00000040:00080000:2.0:1789892543.353229:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].161, 224 off37504 00000040:00080000:2.0:1789892543.353285:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].185, 224 off41944 20000000:01000000:2.0:1789892543.353291:0:215071:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789892543.353300:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].186, 112 off42056 00000040:00080000:2.0:1789892543.353310:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].187, 224 off42280 00000040:00080000:2.0:1789892543.353344:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].185, 224 off41944 20000000:01000000:2.0:1789892543.353350:0:215071:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789892543.353358:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].186, 112 off42056 00000040:00080000:2.0:1789892543.353367:0:215071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].187, 224 off42280 10000000:01000000:2.0:1789892543.353382:0:215071:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892543.353396:0:215071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353413:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353419:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353424:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353428:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353432:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353436:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353440:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353444:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353448:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353452:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353460:0:215071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353466:0:215071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353518:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353530:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 23 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.353542:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880064:0@lo:104: 00000100:00100000:2.0:1789892543.353594:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892543.353629:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880064 00000100:00100000:3.0:1789892543.353636:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880064 00010000:00010000:2.0:1789892543.353637:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353645:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 23 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.353651:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880192:0@lo:104: 00000100:00100000:2.0:1789892543.353669:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892543.353693:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880192 00000100:00100000:3.0:1789892543.353699:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880192 00010000:00010000:2.0:1789892543.353704:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353712:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 23 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.353720:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880320:0@lo:104: 00000100:00100000:0.0:1789892543.353725:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789892543.353737:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789892543.353743:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880064:12345-0@lo:104: 00000100:00100000:2.0:1789892543.353755:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892543.353756:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880192:12345-0@lo:104: 00010000:00010000:0.0:1789892543.353759:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.353772:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880320 00010000:00010000:3.0:1789892543.353773:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.353784:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.353785:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880320 00010000:00010000:2.0:1789892543.353795:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 23 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.353804:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880448:0@lo:104: 00000100:00100000:1.0:1789892543.353821:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789892543.353831:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215071:x1876834915880320:12345-0@lo:104: 00010000:00010000:0.0:1789892543.353835:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892543.353840:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.353845:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892543.353847:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892543.353858:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215071:x1876834915880064:12345-0@lo:104: Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.353860:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215071:x1876834915880192:12345-0@lo:104: Request processed in 111us (187us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892543.353869:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.353879:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00010000:00010000:2.0:1789892543.353883:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 23 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.353892:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789892543.353896:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880576:0@lo:104: 00010000:00010000:1.0:1789892543.353901:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892543.353909:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215071:x1876834915880320:12345-0@lo:104: Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892543.353916:0:189422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892543.353919:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789892543.353924:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880448 00010000:00010000:2.0:1789892543.353928:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.353930:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880448 00000100:00100000:3.0:1789892543.353940:0:193633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892543.353943:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 23 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.353952:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880704:0@lo:104: 00000100:00100000:3.0:1789892543.353965:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880576 00000100:00100000:3.0:1789892543.353970:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880576 00010000:00010000:1.0:1789892543.353971:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789892543.353976:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1789892543.353981:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892543.353981:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.353991:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880704 00000100:00100000:0.0:1789892543.353993:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b600fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880448:12345-0@lo:104: 00010000:00010000:1.0:1789892543.353994:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffa00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892543.353995:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880704 10000000:00010000:1.0:1789892543.354002:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.354009:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354009:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354013:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.354014:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1789892543.354027:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215071:x1876834915880576:12345-0@lo:104: 00010000:00010000:2.0:1789892543.354035:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 23 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892543.354040:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354043:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892543.354056:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892543.354073:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880832:0@lo:104: 00010000:00010000:0.0:1789892543.354080:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892543.354089:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b600fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215071:x1876834915880448:12345-0@lo:104: Request processed in 102us (246us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892543.354096:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354098:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:3.0:1789892543.354103:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789892543.354111:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892543.354115:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880576:12345-0@lo:104: Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892543.354121:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892543.354132:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00010000:00010000:1.0:1789892543.354133:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354145:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880832 00010000:00010000:1.0:1789892543.354146:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002133eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133f2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.354151:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354152:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880832 00000100:00100000:3.0:1789892543.354155:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00010000:00010000:2.0:1789892543.354169:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 23 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.354172:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880704:12345-0@lo:104: 00010000:00010000:1.0:1789892543.354172:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892543.354181:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354185:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00010000:00010000:3.0:1789892543.354187:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354190:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881088:0@lo:104: 00010000:00010000:1.0:1789892543.354203:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892543.354203:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880832:12345-0@lo:104: 10000000:00010000:1.0:1789892543.354211:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354218:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354222:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354224:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892543.354248:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354252:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:1.0:1789892543.354262:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892543.354263:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880704:12345-0@lo:104: Request processed in 98us (287us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892543.354267:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.354281:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00010000:00010000:2.0:1789892543.354285:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 23 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354294:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354295:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881216:0@lo:104: 00000100:00100000:3.0:1789892543.354297:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915881088 00010000:00010000:0.0:1789892543.354302:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789892543.354303:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915881088 00010000:00010000:1.0:1789892543.354311:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892543.354318:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915880832:12345-0@lo:104: Request processed in 118us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.354327:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00010000:00010000:1.0:1789892543.354329:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.354336:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915881088:12345-0@lo:104: 00000100:00100000:0.0:1789892543.354340:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00010000:1.0:1789892543.354345:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd002133dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133e4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354346:0:215071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892543.354353:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354362:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1789892543.354368:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915881216 00010000:00010000:1.0:1789892543.354371:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354374:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915881216 00010000:00010000:2.0:1789892543.354376:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354385:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:1.0:1789892543.354389:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892543.354398:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915881088:12345-0@lo:104: Request processed in 61us (172us total) trans 0 rc 0/0 10000000:00010000:1.0:1789892543.354398:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.354400:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 9 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354406:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00010000:00010000:1.0:1789892543.354423:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.354425:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789892543.354428:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881472:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892543.354433:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215071:x1876834915881216:12345-0@lo:104: 10000000:00010000:1.0:1789892543.354441:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892543.354447:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892543.354448:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354449:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789892543.354458:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354468:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff600 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892543.354472:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892543.354473:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354478:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892543.354485:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354513:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd002133cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133d6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354523:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:3.0:1789892543.354528:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354537:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 10000000:00010000:3.0:1789892543.354538:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.354539:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215071:x1876834915881216:12345-0@lo:104: Request processed in 109us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892543.354541:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.354546:0:215071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892543.354562:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892543.354564:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe600 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892543.354565:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 10000000:00010000:1.0:1789892543.354570:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.354590:0:215071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354594:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354594:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789892543.354597:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354601:0:215071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881728:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892543.354605:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892543.354618:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354620:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892543.354630:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354632:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff000 already unused, calling callback (ffffffffc112ec20) 10000000:01000000:1.0:1789892543.354633:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892543.354642:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354646:0:215071:0:(client.c:2702:ptlrpc_set_wait()) set ffff906990f9c180 going to sleep for 11 seconds 00010000:00010000:3.0:1789892543.354647:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd002133c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133c8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354658:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354666:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354668:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:0.0:1789892543.354670:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354677:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354677:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892543.354678:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880064:0@lo:104: 00010000:00010000:1.0:1789892543.354687:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354695:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880192:0@lo:104: 10000000:01000000:0.0:1789892543.354696:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892543.354703:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffee00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892543.354708:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354712:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880320:0@lo:104: 00010000:00010000:1.0:1789892543.354712:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002133b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133ba expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354721:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354727:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880448:0@lo:104: 00010000:00010000:0.0:1789892543.354732:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354740:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789892543.354743:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880576:0@lo:104: 10000000:00010000:3.0:1789892543.354745:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354749:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354756:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892543.354758:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880704:0@lo:104: 00010000:00010000:0.0:1789892543.354768:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354770:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800e00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892543.354774:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915880832:0@lo:104: 10000000:01000000:3.0:1789892543.354777:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789892543.354777:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354788:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881088:0@lo:104: 00010000:00010000:1.0:1789892543.354801:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354802:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.354805:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881216:0@lo:104: 00010000:00010000:0.0:1789892543.354809:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002133a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002133ac expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354827:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789892543.354827:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354835:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354839:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789892543.354842:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892543.354848:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354852:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213397 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021339e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354865:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354866:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801000 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892543.354873:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892543.354875:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892543.354875:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.354878:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892543.354884:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892543.354885:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354891:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354893:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd00213389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213390 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892543.354915:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.354920:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892543.354922:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915881344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892543.354927:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789892543.354927:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892543.354932:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892543.354940:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915880960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892543.354951:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915881600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892543.354952:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.354966:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892543.354970:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892543.354979:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892543.354985:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.354995:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd0021337b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213382 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.355005:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915881984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892543.355009:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892543.355018:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892543.355028:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892543.355031:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892543.355036:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915882112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892543.355037:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892543.355042:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892543.355044:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915882240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892543.355054:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892543.355068:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915881344 00000100:00100000:2.0:1789892543.355070:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915882496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892543.355074:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915881344 00000100:00100000:3.0:1789892543.355080:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892543.355106:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 24 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355117:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915880960 00000100:00100000:2.0:1789892543.355118:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.355123:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915880960 00010000:00010000:1.0:1789892543.355141:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 25 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355143:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915881600 00000100:00100000:0.0:1789892543.355145:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915881984 00000100:00100000:3.0:1789892543.355149:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915881600 00000100:00100000:2.0:1789892543.355151:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789892543.355154:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915881984 00000100:00100000:2.0:1789892543.355160:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915881856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892543.355165:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882112 00010000:00010000:3.0:1789892543.355171:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 27 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355173:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882112 00010000:00010000:0.0:1789892543.355178:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 27 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355195:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882496 00010000:00010000:1.0:1789892543.355198:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 28 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355201:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882496 00000100:00100000:2.0:1789892543.355203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892543.355206:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789892543.355222:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915882368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355225:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 29 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.355225:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc394c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3621:x1876834915881344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892543.355241:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915881856 00000100:00100000:2.0:1789892543.355255:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892543.355255:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915881856 00010000:00010000:0.0:1789892543.355257:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892543.355275:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 30 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.355284:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 30 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.355290:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 30 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.355300:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882368 00010000:00010000:0.0:1789892543.355300:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f200/0x5c4f93dd002133e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002133dd expref: 30 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.355307:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882368 00000100:00100000:1.0:1789892543.355311:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00010000:00010000:0.0:1789892543.355315:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892543.355322:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3620:x1876834915880960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892543.355328:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 30 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.355333:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892543.355337:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00010000:00010000:1.0:1789892543.355341:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 30 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.355353:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc394c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3621:x1876834915881344:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892543.355357:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 30 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355361:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3622:x1876834915881600:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892543.355366:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00010000:00010000:3.0:1789892543.355380:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892543.355383:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789892543.355385:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3620:x1876834915881984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892543.355385:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd002133f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002133eb expref: 30 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.355389:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 30 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.355401:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892543.355419:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892543.355420:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 28 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.355425:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 28 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.355435:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00010000:00010000:2.0:1789892543.355438:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 28 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.355454:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3621:x1876834915882112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355462:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837400/0x5c4f93dd002133d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002133cf expref: 28 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355462:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3620:x1876834915880960:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (481us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892543.355462:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892543.355463:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837e00/0x5c4f93dd002133ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002133b3 expref: 28 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.355481:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 28 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355522:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00010000:00010000:0.0:1789892543.355535:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 27 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355545:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00010000:00010000:3.0:1789892543.355549:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892543.355557:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836400/0x5c4f93dd002133ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002133a5 expref: 26 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355558:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915881856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892543.355572:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892543.355575:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892543.355579:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 25 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355585:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915881600:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (580us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892543.355596:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 25 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355597:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1789892543.355611:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3621:x1876834915882112:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (530us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892543.355614:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f800/0x5c4f93dd002133c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002133c1 expref: 24 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892543.355620:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1789892543.355630:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00010000:00010000:1.0:1789892543.355638:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892543.355644:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915882496:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892543.355651:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00010000:00010000:3.0:1789892543.355663:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892543.355663:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915882368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355676:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 22 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355676:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915881856:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (475us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892543.355677:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892543.355679:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892543.355690:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 21 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355695:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00010000:00010000:3.0:1789892543.355703:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 21 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.355715:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3620:x1876834915881984:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (678us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892543.355717:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 20 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.355730:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1789892543.355740:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915881856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355741:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd00213382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021337b expref: 20 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892543.355746:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213389 expref: 19 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.355762:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915880960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355774:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892543.355775:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892543.355777:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892543.355780:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915881984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892543.355819:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3620:x1876834915882496:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.355834:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1789892543.355834:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915881600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892543.355836:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915882368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892543.355840:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3620:x1876834915882368:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.355858:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882240 00000100:00100000:0.0:1789892543.355859:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1789892543.355864:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882240 00000100:00100000:1.0:1789892543.355864:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915882496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892543.355899:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915881344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892543.355905:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915882112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355964:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 16 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.355984:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1789892543.355990:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bc397c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3622:x1876834915882240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892543.355997:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892543.356001:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 16 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.356008:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 16 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.356017:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837000/0x5c4f93dd0021339e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213397 expref: 16 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892543.356026:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892543.356043:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881472:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892543.356055:0:215071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215071:1876834915881728:192.168.204.33@tcp:104: 00000100:00100000:3.0:1789892543.356068:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bc397c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915882240:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892543.356075:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789892543.356099:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915882240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892543.356123:0:215071:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892543.356409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892543.356437:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849472 00000100:00100000:2.0:1789892543.356442:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849472 00010000:00010000:2.0:1789892543.356456:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 10 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892543.356506:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 482 00000100:00100000:2.0:1789892543.356514:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925849472:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789892543.356515:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1789892543.356521:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892543.356526:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 10 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.356533:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849344 00010000:00010000:2.0:1789892543.356538:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 10 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.356539:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849344 00010000:00010000:2.0:1789892543.356552:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837800/0x5c4f93dd00213374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a606 expref: 11 pid: 189434 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356558:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 11 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.356561:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892543.356585:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 483 00000100:00100000:2.0:1789892543.356592:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925849472:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.356594:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925849344:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892543.356607:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892543.356608:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 482 00010000:00010000:1.0:1789892543.356613:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 10 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356625:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356649:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd0021336d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5ff expref: 9 pid: 189432 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356662:0:192465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356671:0:192465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356684:0:192465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356692:0:192465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356699:0:192465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356707:0:192465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356712:0:192465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffec00 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:1.0:1789892543.356717:0:192465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356725:0:192465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356743:0:192465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.356760:0:215071:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892543.356760:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892543.356785:0:215071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892543.356790:0:215071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002133f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892543.356794:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2400:x1876834925849344:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 201us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892543.356807:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 483 00010000:00010000:3.0:1789892544.290651:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892544.399367:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892544.399418:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892544.399424:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849728 00000100:00100000:2.0:1789892544.399436:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849728 00000100:00100000:3.0:1789892544.399454:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892544.399486:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849600 00000100:00100000:2.0:1789892544.399538:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849856 00000100:00100000:2.0:1789892544.399544:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849856 00000100:00100000:1.0:1789892544.399546:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 465 00000100:00100000:0.0:1789892544.399546:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849600 00000100:00100000:1.0:1789892544.399562:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:2402:x1876834925849728:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:3.0:1789892544.399578:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892544.399599:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 466 00000100:00100000:0.0:1789892544.399606:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2025 00000100:00100000:2.0:1789892544.399613:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925849856:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892544.399622:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2401:x1876834925849600:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892544.399636:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:2402:x1876834925849728:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892544.399644:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 465 00000100:00100000:2.0:1789892544.399661:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+5:2401:x1876834925849856:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.399669:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2401:x1876834925849600:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892544.399676:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 466 00000100:00100000:0.0:1789892544.399685:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2025 00000100:00100000:0.0:1789892544.527583:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892544.527640:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925849984 00000100:00100000:3.0:1789892544.527650:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925849984 00000100:00100000:3.0:1789892544.527710:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2026 00000100:00100000:3.0:1789892544.527721:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925849984:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892544.527740:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892544.527762:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a60d expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.527793:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.527803:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.527811:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f600, rc 0) 00000100:00100000:3.0:1789892544.527859:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925849984:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 142us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.527865:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2026 00000100:00100000:3.0:1789892544.529260:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892544.529340:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850112 00000100:00100000:0.0:1789892544.529350:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850112 00000100:00100000:0.0:1789892544.529407:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2027 00000100:00100000:0.0:1789892544.529424:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925850112:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892544.529596:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925850112:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 178us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.529606:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2027 00000100:00100000:0.0:1789892544.530541:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892544.530583:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850240 00000100:00100000:3.0:1789892544.530590:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850240 00000100:00100000:3.0:1789892544.530630:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2028 00000100:00100000:3.0:1789892544.530639:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925850240:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892544.530751:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925850240:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.530761:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2028 00000100:00100000:3.0:1789892544.532275:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892544.532349:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850368 00000100:00100000:0.0:1789892544.532357:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850368 00000100:00100000:0.0:1789892544.532405:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2029 00000100:00100000:0.0:1789892544.532417:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213866:x1876834925850368:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892544.532561:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213866:x1876834925850368:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 146us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.532571:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2029 00000100:00100000:0.0:1789892544.533540:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892544.533570:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850496 00000100:00100000:3.0:1789892544.533575:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850496 00000100:00100000:3.0:1789892544.533602:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2030 00000100:00100000:3.0:1789892544.533611:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213866:x1876834925850496:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892544.533691:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213866:x1876834925850496:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.533701:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2030 00000100:00100000:3.0:1789892544.534840:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892544.534915:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850624 00000100:00100000:0.0:1789892544.534924:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850624 00000100:00100000:0.0:1789892544.534990:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2031 00000100:00100000:0.0:1789892544.535004:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925850624:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892544.535019:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892544.535036:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a614 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892544.535064:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892544.535080:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892544.535107:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836200, rc 0) 00000100:00100000:0.0:1789892544.535159:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925850624:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 156us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.535171:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2031 00000100:00100000:0.0:1789892544.535904:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892544.535943:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850752 00000100:00100000:3.0:1789892544.535948:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850752 00000100:00100000:3.0:1789892544.535974:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2032 00000100:00100000:3.0:1789892544.535982:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925850752:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892544.536040:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925850752:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 59us (137us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892544.536047:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2032 10000000:01000000:1.0:1789892544.994596:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892544.994605:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 159 10000000:01000000:1.0:1789892544.994611:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892544.994659:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.994669:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.994678:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.994699:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915882624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.994760:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.994799:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892544.994862:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882624 00000100:00100000:0.0:1789892544.994870:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882624 00000100:00100000:0.0:1789892544.994917:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1789892544.994925:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915882624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892544.994938:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892544.994950:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021340e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892544.994989:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892544.994997:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892544.995004:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836c00, rc 0) 00000100:00100000:0.0:1789892544.995045:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915882624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.995051:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1789892544.995071:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915882624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892544.995085:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.995100:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.995148:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915882752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.995170:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.995190:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.995234:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882752 00000100:00100000:3.0:1789892544.995240:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882752 00000100:00100000:3.0:1789892544.995274:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1789892544.995283:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915882752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892544.995400:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915882752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.995408:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:1.0:1789892544.995425:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915882752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.995454:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915882880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.995506:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.995525:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892544.995555:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915882880 00000100:00100000:0.0:1789892544.995560:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915882880 00000100:00100000:0.0:1789892544.995584:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1789892544.995591:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915882880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892544.995669:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915882880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.995679:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1789892544.995681:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915882880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892544.996052:0:215072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215072:1876834915883008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892544.996088:0:215072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892544.996110:0:215072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068873fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.996124:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883008 00000100:00100000:3.0:1789892544.996129:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883008 00000100:00100000:3.0:1789892544.996154:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1789892544.996169:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215072:x1876834915883008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892544.996278:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215072:x1876834915883008:12345-0@lo:502:llog_process_th.0 Request processed in 109us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.996286:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1789892544.996303:0:215072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215072:1876834915883008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892544.996343:0:215072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215072:1876834915883136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892544.996369:0:215072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892544.996386:0:215072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069bfddf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892544.996425:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883136 00000100:00100000:2.0:1789892544.996430:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883136 00000100:00100000:2.0:1789892544.996459:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:2.0:1789892544.996465:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215072:x1876834915883136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892544.996558:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215072:x1876834915883136:12345-0@lo:502:llog_process_th.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892544.996565:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1789892544.996586:0:215072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215072:1876834915883136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892544.996611:0:215072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:1.0:1789892544.996683:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:1.0:1789892544.996701:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892544.996707:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.996714:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892544.996721:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892544.996722:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:1.0:1789892544.996724:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892544.996736:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.996742:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.996752:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.996762:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.996783:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.996806:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.996826:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883264 00000100:00100000:3.0:1789892544.996831:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883264 00000100:00100000:3.0:1789892544.996856:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:3.0:1789892544.996863:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915883264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892544.996870:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892544.996880:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021341c expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.996895:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.996905:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.996913:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f000, rc 0) 00000100:00100000:3.0:1789892544.996945:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915883264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.996951:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1789892544.996960:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892544.996971:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.996980:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.997014:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.997033:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.997046:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892544.997099:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883392 00000100:00100000:2.0:1789892544.997105:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883392 00000100:00100000:2.0:1789892544.997130:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1789892544.997138:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915883392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892544.997228:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915883392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892544.997235:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1789892544.997248:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.997277:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.997309:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.997326:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.997350:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883520 00000100:00100000:3.0:1789892544.997354:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883520 00000100:00100000:3.0:1789892544.997379:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:3.0:1789892544.997387:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915883520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892544.997457:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915883520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892544.997470:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892544.997471:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000040:00080000:3.0:1789892544.998076:0:215073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789892544.998134:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892544.998150:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892544.998156:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.998170:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892544.998176:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892544.998177:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 159 10000000:01000000:1.0:1789892544.998179:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892544.998189:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.998195:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.998219:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.998233:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.998259:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.998279:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892544.998309:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883648 00000100:00100000:2.0:1789892544.998314:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883648 00000100:00100000:2.0:1789892544.998339:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:2.0:1789892544.998346:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915883648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892544.998354:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892544.998361:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021342a expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892544.998374:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892544.998381:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892544.998385:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffec00, rc 0) 00000100:00100000:2.0:1789892544.998415:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915883648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892544.998420:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1789892544.998445:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892544.998455:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.998461:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.998486:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.998545:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.998573:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.998580:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883776 00000100:00100000:3.0:1789892544.998585:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883776 00000100:00100000:3.0:1789892544.998610:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:3.0:1789892544.998618:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915883776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892544.998682:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915883776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.998690:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1789892544.998698:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.998721:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.998753:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.998766:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892544.998793:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915883904 00000100:00100000:2.0:1789892544.998799:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915883904 00000100:00100000:2.0:1789892544.998828:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1789892544.998835:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915883904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892544.998895:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915883904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892544.998904:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915883904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892544.998916:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1789892544.999086:0:215074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215074:1876834915884032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892544.999114:0:215074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892544.999130:0:215074:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.999147:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884032 00000100:00100000:3.0:1789892544.999151:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884032 00000100:00100000:3.0:1789892544.999176:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1789892544.999183:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215074:x1876834915884032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892544.999272:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215074:x1876834915884032:12345-0@lo:502:llog_process_th.0 Request processed in 88us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.999280:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:2.0:1789892544.999299:0:215074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215074:1876834915884032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892544.999333:0:215074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215074:1876834915884160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892544.999358:0:215074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892544.999373:0:215074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892544.999391:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884160 00000100:00100000:0.0:1789892544.999396:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884160 00000100:00100000:0.0:1789892544.999420:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:0.0:1789892544.999425:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215074:x1876834915884160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892544.999486:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215074:x1876834915884160:12345-0@lo:502:llog_process_th.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892544.999511:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1789892544.999519:0:215074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215074:1876834915884160:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892544.999540:0:215074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:1.0:1789892544.999589:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:1.0:1789892544.999609:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892544.999614:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.999620:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892544.999625:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892544.999626:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:1.0:1789892544.999628:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892544.999639:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.999644:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.999649:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.999657:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.999676:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.999707:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892544.999715:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884288 00000100:00100000:3.0:1789892544.999720:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884288 00000100:00100000:3.0:1789892544.999746:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:3.0:1789892544.999753:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915884288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892544.999760:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892544.999768:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213438 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.999783:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.999804:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892544.999812:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e000, rc 0) 00000100:00100000:3.0:1789892544.999844:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915884288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892544.999851:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:1.0:1789892544.999860:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892544.999871:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892544.999880:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892544.999915:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892544.999934:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892544.999947:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892544.999964:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884416 00000100:00100000:0.0:1789892544.999968:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884416 00000100:00100000:0.0:1789892544.999991:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1789892544.999997:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915884416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892545.000059:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915884416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.000064:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:1.0:1789892545.000069:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.000091:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.000118:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.000133:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.000150:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884544 00000100:00100000:3.0:1789892545.000154:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884544 00000100:00100000:3.0:1789892545.000180:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1789892545.000186:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915884544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892545.000265:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915884544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.000273:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:1.0:1789892545.000281:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892545.000924:0:215075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:1.0:1789892545.000978:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:1.0:1789892545.000994:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892545.000999:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.001008:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892545.001016:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892545.001017:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 159 10000000:01000000:1.0:1789892545.001019:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892545.001035:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.001041:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.001046:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.001054:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.001073:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.001091:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.001108:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884672 00000100:00100000:0.0:1789892545.001114:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884672 00000100:00100000:0.0:1789892545.001141:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1789892545.001148:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915884672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892545.001154:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892545.001162:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213446 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.001174:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.001181:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.001191:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836800, rc 0) 00000100:00100000:0.0:1789892545.001231:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915884672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.001238:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1789892545.001244:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892545.001256:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.001262:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.001289:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.001307:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.001323:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.001341:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884800 00000100:00100000:3.0:1789892545.001345:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884800 00000100:00100000:3.0:1789892545.001371:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:3.0:1789892545.001378:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915884800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892545.001442:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915884800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.001449:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:1.0:1789892545.001451:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.001473:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.001535:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.001561:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.001563:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915884928 00000100:00100000:0.0:1789892545.001568:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915884928 00000100:00100000:0.0:1789892545.001591:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:0.0:1789892545.001596:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915884928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892545.001652:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915884928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.001659:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:1.0:1789892545.001662:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915884928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.001843:0:215076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215076:1876834915885056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.001870:0:215076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.001887:0:215076:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.001901:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885056 00000100:00100000:3.0:1789892545.001905:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885056 00000100:00100000:3.0:1789892545.001930:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1789892545.001936:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215076:x1876834915885056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892545.002010:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215076:x1876834915885056:12345-0@lo:502:llog_process_th.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.002017:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1789892545.002018:0:215076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215076:1876834915885056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.002051:0:215076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215076:1876834915885184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.002082:0:215076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.002098:0:215076:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.002118:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885184 00000100:00100000:0.0:1789892545.002124:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885184 00000100:00100000:0.0:1789892545.002146:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:0.0:1789892545.002152:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215076:x1876834915885184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.002220:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215076:x1876834915885184:12345-0@lo:502:llog_process_th.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.002226:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1789892545.002229:0:215076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215076:1876834915885184:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892545.002254:0:215076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:2.0:1789892545.002315:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:2.0:1789892545.002330:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892545.002335:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.002342:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892545.002349:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892545.002350:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 185 10000000:01000000:2.0:1789892545.002352:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892545.002364:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.002370:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.002386:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.002397:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.002420:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.002438:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.002452:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885312 00000100:00100000:3.0:1789892545.002456:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885312 00000100:00100000:3.0:1789892545.002481:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1789892545.002488:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915885312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892545.002511:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892545.002521:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213454 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.002537:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.002547:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.002556:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fe00, rc 0) 00000100:00100000:3.0:1789892545.002589:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915885312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.002598:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:2.0:1789892545.002607:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892545.002619:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.002625:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.002654:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.002673:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.002693:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.002707:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885440 00000100:00100000:0.0:1789892545.002711:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885440 00000100:00100000:0.0:1789892545.002733:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1789892545.002738:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915885440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892545.002792:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915885440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.002797:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:2.0:1789892545.002824:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.002845:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.002872:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.002886:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.002903:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885568 00000100:00100000:3.0:1789892545.002908:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885568 00000100:00100000:3.0:1789892545.002932:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1789892545.002939:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915885568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892545.003008:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915885568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892545.003024:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892545.003028:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1789892545.003220:0:215077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215077:1876834915885696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892545.003247:0:215077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.003266:0:215077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.003281:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885696 00000100:00100000:0.0:1789892545.003285:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885696 00000100:00100000:0.0:1789892545.003307:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1789892545.003313:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215077:x1876834915885696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.003385:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215077:x1876834915885696:12345-0@lo:502:llog_process_th.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.003390:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1789892545.003413:0:215077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215077:1876834915885696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892545.003432:0:215077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892545.003440:0:215077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892545.003442:0:215077:0:(obd_config.c:1561:class_process_config()) marker 175 (0x1) lustre-MDT0001-m new lustre.qpool1 00000020:00000080:2.0:1789892545.003445:0:215077:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1789892545.003513:0:215077:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00000100:00100000:2.0:1789892545.003530:0:215077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215077:1876834915885824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892545.003556:0:215077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.003575:0:215077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.003599:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885824 00000100:00100000:3.0:1789892545.003604:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885824 00000100:00100000:3.0:1789892545.003631:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1789892545.003637:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215077:x1876834915885824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892545.003703:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215077:x1876834915885824:12345-0@lo:502:llog_process_th.0 Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.003710:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1789892545.003717:0:215077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215077:1876834915885824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892545.003736:0:215077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892545.003739:0:215077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892545.003741:0:215077:0:(obd_config.c:1561:class_process_config()) marker 175 (0x2) lustre-MDT0001-m new lustre.qpool1 00000040:00080000:2.0:1789892545.003743:0:215077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 188 count 184 00000020:01000000:1.0:1789892545.003792:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 185-187 (rc=0) 10000000:01000000:1.0:1789892545.003812:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892545.003818:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.003825:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892545.003830:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892545.003832:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 159 10000000:01000000:1.0:1789892545.003834:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892545.003845:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.003850:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.003855:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.003870:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.003890:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.003904:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.003921:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915885952 00000100:00100000:0.0:1789892545.003925:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915885952 00000100:00100000:0.0:1789892545.003949:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:0.0:1789892545.003954:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915885952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892545.003960:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892545.003966:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213462 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.003977:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.003983:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.003988:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892545.004017:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915885952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.004022:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1789892545.004026:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915885952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892545.004039:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.004046:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.004073:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.004090:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.004102:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.004154:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886080 00000100:00100000:3.0:1789892545.004160:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886080 00000100:00100000:3.0:1789892545.004186:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1789892545.004193:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915886080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892545.004271:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915886080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.004277:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:1.0:1789892545.004282:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.004304:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.004331:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.004344:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.004361:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886208 00000100:00100000:0.0:1789892545.004365:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886208 00000100:00100000:0.0:1789892545.004387:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1789892545.004393:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915886208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892545.004453:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915886208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.004459:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:1.0:1789892545.004461:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.004641:0:215078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215078:1876834915886336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.004668:0:215078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.004688:0:215078:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e7296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.004697:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886336 00000100:00100000:3.0:1789892545.004702:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886336 00000100:00100000:3.0:1789892545.004723:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1789892545.004728:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215078:x1876834915886336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892545.004791:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215078:x1876834915886336:12345-0@lo:502:llog_process_th.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.004798:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1789892545.004798:0:215078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215078:1876834915886336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.004835:0:215078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215078:1876834915886464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.004864:0:215078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.004878:0:215078:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e7296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.004917:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886464 00000100:00100000:0.0:1789892545.004924:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886464 00000100:00100000:0.0:1789892545.004956:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1789892545.004964:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215078:x1876834915886464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.005048:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215078:x1876834915886464:12345-0@lo:502:llog_process_th.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892545.005051:0:215078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215078:1876834915886464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.005064:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000040:00080000:1.0:1789892545.005072:0:215078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:2.0:1789892545.005122:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:2.0:1789892545.005140:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892545.005145:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.005151:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892545.005157:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892545.005158:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 185 10000000:01000000:2.0:1789892545.005160:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892545.005170:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.005176:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.005186:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.005196:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.005227:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.005241:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.005267:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886592 00000100:00100000:3.0:1789892545.005272:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886592 00000100:00100000:3.0:1789892545.005299:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:3.0:1789892545.005305:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915886592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892545.005317:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892545.005324:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213470 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.005337:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.005343:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.005348:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e200, rc 0) 00000100:00100000:3.0:1789892545.005379:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915886592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.005385:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1789892545.005404:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892545.005416:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.005422:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.005450:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.005471:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.005484:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.005536:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886720 00000100:00100000:0.0:1789892545.005542:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886720 00000100:00100000:0.0:1789892545.005573:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1789892545.005586:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915886720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892545.005660:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915886720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.005668:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1789892545.005671:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.005696:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.005722:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.005742:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892545.005752:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886848 00000100:00100000:3.0:1789892545.005756:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886848 00000100:00100000:3.0:1789892545.005777:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:3.0:1789892545.005783:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915886848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892545.005842:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915886848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.005847:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:2.0:1789892545.005861:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915886848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892545.006006:0:215079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215079:1876834915886976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892545.006035:0:215079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892545.006049:0:215079:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.006069:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915886976 00000100:00100000:0.0:1789892545.006074:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915886976 00000100:00100000:0.0:1789892545.006100:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1789892545.006108:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215079:x1876834915886976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.006213:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215079:x1876834915886976:12345-0@lo:502:llog_process_th.0 Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892545.006214:0:215079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215079:1876834915886976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.006228:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000020:01000000:1.0:1789892545.006239:0:215079:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892545.006245:0:215079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892545.006246:0:215079:0:(obd_config.c:1561:class_process_config()) marker 174 (0x1) lustre-MDT0000-m new lustre.qpool1 00000020:00000080:1.0:1789892545.006251:0:215079:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1789892545.006279:0:215079:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00080000:10000000:1.0:1789892545.006758:0:215079:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00080000:10000000:3.0:1789892545.008123:0:215079:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (8/32) registered 00080000:10000000:3.0:1789892545.008992:0:215079:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x56:0x0] (8/32) registered 00000100:00100000:3.0:1789892545.009667:0:215079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215079:1876834915887104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892545.009698:0:215079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892545.009719:0:215079:0:(client.c:2702:ptlrpc_set_wait()) set ffff906982e41600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.009746:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887104 00000100:00100000:0.0:1789892545.009752:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887104 00000100:00100000:0.0:1789892545.009786:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1789892545.009794:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215079:x1876834915887104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892545.009864:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215079:x1876834915887104:12345-0@lo:502:llog_process_th.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.009872:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:3.0:1789892545.009889:0:215079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215079:1876834915887104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892545.009914:0:215079:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892545.009918:0:215079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892545.009920:0:215079:0:(obd_config.c:1561:class_process_config()) marker 174 (0x2) lustre-MDT0000-m new lustre.qpool1 00000040:00080000:3.0:1789892545.009922:0:215079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 188 count 184 00000020:01000000:2.0:1789892545.009968:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 185-187 (rc=0) 10000000:01000000:2.0:1789892545.009988:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892545.009993:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.010006:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892545.010012:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892545.010013:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892545.010015:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892545.010027:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.010032:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.010037:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.010047:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915887232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.010069:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.010085:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.010110:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887232 00000100:00100000:0.0:1789892545.010115:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887232 00000100:00100000:0.0:1789892545.010140:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1789892545.010148:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915887232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892545.010155:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892545.010164:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021347e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.010179:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.010188:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.010195:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836400, rc 0) 00000100:00100000:0.0:1789892545.010241:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915887232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.010248:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1789892545.010267:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915887232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892545.010277:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.010283:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.010310:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915887360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892545.010328:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.010348:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.010368:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887360 00000100:00100000:0.0:1789892545.010373:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887360 00000100:00100000:0.0:1789892545.010397:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1789892545.010404:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915887360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892545.010457:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915887360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892545.010471:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1789892545.010477:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915887360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892545.010515:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892545.010520:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.010525:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.314653:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789892545.994624:0:215176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd8b41d820 20000000:00000080:2.0:1789892545.994642:0:215176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9069af806400 uarg=0000000000000000 00000040:00100000:2.0:1789892545.995671:0:215176:0:(llog.c:1072:llog_reverse_process()) index 161 : idx 137 20000000:01000000:2.0:1789892545.995678:0:215176:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 160 cmd:0xce020 lustre.qpool1 00000040:00080000:2.0:1789892545.995801:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].162, 224 off37728 20000000:01000000:2.0:1789892545.995823:0:215176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:2.0:1789892545.995847:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].163, 128 off37856 00000040:00080000:2.0:1789892545.995873:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].164, 224 off38080 00000040:00080000:2.0:1789892545.995953:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].188, 224 off42504 20000000:01000000:2.0:1789892545.995965:0:215176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:2.0:1789892545.995988:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].189, 136 off42640 00000040:00080000:2.0:1789892545.996017:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].190, 224 off42864 00000040:00080000:2.0:1789892545.996118:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].188, 224 off42504 20000000:01000000:2.0:1789892545.996133:0:215176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:2.0:1789892545.996155:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].189, 136 off42640 00000040:00080000:2.0:1789892545.996209:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].190, 224 off42864 10000000:01000000:2.0:1789892545.996245:0:215176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892545.996269:0:215176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996297:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996321:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996333:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996344:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996356:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996367:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996378:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996388:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996398:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996431:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996439:0:215176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996457:0:215176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996497:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996512:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 23 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.996548:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887488:0@lo:104: 00000100:00100000:2.0:1789892545.996614:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892545.996667:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996676:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 23 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.996688:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887616:0@lo:104: 00000100:00100000:3.0:1789892545.996694:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887488 00000100:00100000:3.0:1789892545.996702:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887488 00000100:00100000:2.0:1789892545.996721:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892545.996754:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.996763:0:193633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789892545.996767:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 23 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.996773:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887616 00000100:00100000:0.0:1789892545.996780:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887616 00000100:00100000:3.0:1789892545.996781:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789892545.996783:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887744:0@lo:104: 00000100:00100000:3.0:1789892545.996795:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215176:x1876834915887488:12345-0@lo:104: 00010000:00010000:3.0:1789892545.996807:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.996819:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892545.996832:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887744 00000100:00100000:0.0:1789892545.996836:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887744 00000100:00100000:1.0:1789892545.996847:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1789892545.996860:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b600e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915887616:12345-0@lo:104: 00010000:00010000:1.0:1789892545.996870:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.996872:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00010000:00010000:3.0:1789892545.996878:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892545.996888:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915887488:12345-0@lo:104: Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.996889:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915887744:12345-0@lo:104: 00000100:00100000:3.0:1789892545.996902:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00010000:00010000:0.0:1789892545.996904:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.996911:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.996925:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892545.996928:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892545.996932:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 23 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.996934:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b600e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215176:x1876834915887616:12345-0@lo:104: Request processed in 77us (212us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892545.996937:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.996973:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00010000:00010000:0.0:1789892545.996975:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892545.996986:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffee00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892545.996991:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887872:0@lo:104: 00000100:00100000:0.0:1789892545.996993:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915887744:12345-0@lo:104: Request processed in 105us (170us total) trans 0 rc 0/0 10000000:00010000:3.0:1789892545.996995:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.997014:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:3.0:1789892545.997015:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892545.997025:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.997030:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892545.997037:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997056:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789892545.997066:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892545.997068:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892545.997077:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892545.997108:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff200 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892545.997111:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800c00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892545.997114:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892545.997116:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.997131:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915887872 00010000:00010000:1.0:1789892545.997136:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.997142:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915887872 00010000:00010000:0.0:1789892545.997144:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997146:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892545.997147:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892545.997174:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892545.997205:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892545.997206:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789892545.997212:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892545.997215:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789892545.997236:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915887872:12345-0@lo:104: 00010000:00010000:1.0:1789892545.997240:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997246:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.997254:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.997255:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892545.997255:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997266:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021347e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213485 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.997272:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997288:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892545.997303:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213477 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997310:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892545.997316:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892545.997322:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997323:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892545.997323:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892545.997330:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892545.997337:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892545.997338:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213469 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.997352:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892545.997357:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915888128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892545.997357:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892545.997366:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.997367:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915888000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892545.997373:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915887872:12345-0@lo:104: Request processed in 137us (318us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892545.997392:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffea00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892545.997398:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.997399:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789892545.997433:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892545.997438:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997445:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789892545.997445:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892545.997452:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892545.997470:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997478:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.997495:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789892545.997501:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 23 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.997512:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915888256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892545.997529:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892545.997544:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.997570:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888128 00000100:00100000:2.0:1789892545.997573:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888384:0@lo:104: 00000100:00100000:3.0:1789892545.997577:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888128 00010000:00010000:0.0:1789892545.997589:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021345b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997604:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892545.997605:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 24 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.997605:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892545.997611:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892545.997618:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892545.997625:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892545.997631:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789892545.997641:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888256 00000100:00100000:3.0:1789892545.997646:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888256 00000100:00100000:0.0:1789892545.997646:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915888512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892545.997665:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 25 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.997670:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 25 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.997676:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1789892545.997686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892545.997690:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 25 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.997692:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915888128:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892545.997696:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789892545.997711:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915888256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892545.997711:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892545.997717:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888640:0@lo:104: 00010000:00010000:1.0:1789892545.997722:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 25 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997724:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892545.997731:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888512 00010000:00010000:1.0:1789892545.997734:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 25 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.997737:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 25 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.997739:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888512 00000100:00100000:2.0:1789892545.997750:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892545.997757:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 26 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997760:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 26 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.997769:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892545.997781:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892545.997788:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00010000:00010000:2.0:1789892545.997793:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 26 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.997801:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915888512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892545.997813:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 26 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997813:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892545.997820:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915888128:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (408us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892545.997823:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 26 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.997828:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915888256:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892545.997842:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888768:0@lo:104: 00000100:00100000:1.0:1789892545.997843:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789892545.997855:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00010000:00010000:0.0:1789892545.997855:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 26 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.997872:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892545.997882:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.997886:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892545.997900:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888384 00000100:00100000:3.0:1789892545.997904:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888384 00000100:00100000:0.0:1789892545.997922:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915888512:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.997931:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1789892545.997934:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888640 00000100:00100000:3.0:1789892545.997936:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888768 00000100:00100000:2.0:1789892545.997939:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888640 00000100:00100000:3.0:1789892545.997941:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888768 00000100:00100000:1.0:1789892545.997941:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915888128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892545.997947:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888000 00000100:00100000:0.0:1789892545.997958:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888000 00000100:00100000:2.0:1789892545.997973:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00010000:00010000:0.0:1789892545.997977:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 24 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.997981:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915888256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892545.997983:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1789892545.997986:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915888384:12345-0@lo:104: 00000100:00100000:3.0:1789892545.998000:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915888640:12345-0@lo:104: 00010000:00010000:2.0:1789892545.998004:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998007:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.998012:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1789892545.998019:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1789892545.998026:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915888768:12345-0@lo:104: 00000100:00100000:0.0:1789892545.998034:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915888000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892545.998036:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998045:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892545.998051:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 24 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998060:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 24 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.998064:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892545.998070:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892545.998072:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892545.998077:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915888384:12345-0@lo:104: Request processed in 92us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.998099:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915888640:12345-0@lo:104: Request processed in 85us (331us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892545.998102:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892545.998120:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215176:x1876834915888768:12345-0@lo:104: Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892545.998121:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1789892545.998137:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915888000:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892545.998139:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789892545.998156:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1789892545.998157:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00010000:00010000:3.0:1789892545.998204:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892545.998206:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998232:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998236:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892545.998240:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 23 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998243:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998248:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892545.998255:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998267:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801a00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892545.998267:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915888512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892545.998275:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888896:0@lo:104: 10000000:00010000:1.0:1789892545.998276:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998300:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892545.998302:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998303:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998306:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998324:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892545.998328:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892545.998329:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998329:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892545.998335:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892545.998347:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892545.998349:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915888896 10000000:01000000:3.0:1789892545.998350:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892545.998356:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915888896 00010000:00010000:0.0:1789892545.998361:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892545.998377:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998380:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892545.998381:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892545.998384:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998386:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1789892545.998400:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915888896:12345-0@lo:104: 00010000:00010000:1.0:1789892545.998401:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892545.998405:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998406:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892545.998412:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998416:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892545.998418:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998420:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998435:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998438:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd00213438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021343f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998442:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801000/0x5c4f93dd00213446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021344d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.998450:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789892545.998457:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd0021342a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213431 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998461:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915888896:12345-0@lo:104: Request processed in 62us (141us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892545.998464:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892545.998471:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998472:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892545.998476:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892545.998479:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00010000:00010000:3.0:1789892545.998481:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892545.998486:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892545.998488:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892545.998492:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998492:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892545.998493:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892545.998497:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892545.998535:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998537:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.998544:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915889280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892545.998556:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915889024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892545.998556:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 23 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892545.998559:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892545.998577:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892545.998580:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915889408:0@lo:104: 00000100:00100000:0.0:1789892545.998591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892545.998600:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998605:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892545.998613:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915889152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892545.998614:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998622:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892545.998629:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021341c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213423 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998643:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892545.998644:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789892545.998648:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892545.998653:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892545.998656:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915889536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892545.998657:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892545.998662:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.998676:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 9 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998690:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915889664:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892545.998699:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892545.998719:0:193633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892545.998720:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915889280 00000100:00100000:1.0:1789892545.998726:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915889280 00000100:00100000:3.0:1789892545.998730:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915889408 00000100:00100000:3.0:1789892545.998735:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915889408 00010000:00010000:1.0:1789892545.998745:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 24 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.998760:0:215176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.998767:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789892545.998772:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915889152 00000100:00100000:1.0:1789892545.998775:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915889536 00000100:00100000:0.0:1789892545.998779:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915889152 00000100:00100000:1.0:1789892545.998783:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915889536 00010000:00010000:2.0:1789892545.998787:0:215176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 9 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.998789:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915889408:12345-0@lo:104: 00010000:00010000:0.0:1789892545.998800:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 26 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998804:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998807:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 26 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998808:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915889792:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892545.998832:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789892545.998843:0:215176:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892545.998848:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915889280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892545.998864:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836400/0x5c4f93dd00213485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021347e expref: 26 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.998864:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892545.998868:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1789892545.998874:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 26 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892545.998875:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892545.998887:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887488:0@lo:104: 00000100:00100000:1.0:1789892545.998887:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915889152:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892545.998888:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215176:x1876834915889408:12345-0@lo:104: Request processed in 100us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892545.998894:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 25 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998905:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892545.998907:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e200/0x5c4f93dd00213477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213470 expref: 25 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.998908:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00010000:00010000:0.0:1789892545.998912:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892545.998914:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 25 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.998932:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887616:0@lo:104: 00010000:00010000:1.0:1789892545.998936:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 24 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.998950:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892545.998952:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd00213469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213462 expref: 24 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.998958:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915889280:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892545.998966:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887744:0@lo:104: 00000100:00100000:0.0:1789892545.998970:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:2.0:1789892545.998984:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fe00/0x5c4f93dd0021345b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213454 expref: 23 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.998992:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3622:x1876834915889152:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892545.998996:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915887872:0@lo:104: 00000100:00100000:0.0:1789892545.999001:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789892545.999009:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:2.0:1789892545.999014:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836800/0x5c4f93dd0021344d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213446 expref: 21 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.999015:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3619:x1876834915889536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892545.999028:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892545.999032:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888384:0@lo:104: 00010000:00010000:0.0:1789892545.999035:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 19 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.999045:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 19 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.999048:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915889152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892545.999053:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888640:0@lo:104: 00010000:00010000:0.0:1789892545.999063:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892545.999077:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021342a expref: 19 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.999084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892545.999094:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888768:0@lo:104: 00000100:00100000:0.0:1789892545.999095:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3619:x1876834915889536:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892545.999103:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915889024 00000100:00100000:0.0:1789892545.999107:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789892545.999109:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915889024 00010000:00010000:2.0:1789892545.999111:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f000/0x5c4f93dd00213423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021341c expref: 18 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892545.999121:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915888896:0@lo:104: 00010000:00010000:1.0:1789892545.999128:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 17 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892545.999145:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1789892545.999150:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3621:x1876834915889024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892545.999155:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892545.999157:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 17 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.999164:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 17 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.999194:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e000/0x5c4f93dd0021343f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213438 expref: 17 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892545.999203:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892545.999232:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915888000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892545.999234:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915889408:0@lo:104: 00000100:00100000:0.0:1789892545.999240:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915889536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892545.999256:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915889024:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.999260:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915889280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892545.999266:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1789892545.999269:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915889024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892545.999269:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892545.999277:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.999284:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800e00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892545.999287:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.999292:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892545.999297:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892545.999301:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892545.999322:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.999326:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892545.999339:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892545.999344:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915889920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892545.999355:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800e00/0x5c4f93dd0021340e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213415 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892545.999368:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892545.999370:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892545.999373:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892545.999374:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892545.999413:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915889920 00000100:00100000:0.0:1789892545.999422:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915889920 00010000:00010000:0.0:1789892545.999435:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 16 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892545.999455:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1789892545.999460:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915889920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892545.999466:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892545.999469:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 16 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.999476:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 16 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.999484:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836c00/0x5c4f93dd00213415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021340e expref: 16 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892545.999513:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892545.999544:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3621:x1876834915889920:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892545.999554:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789892545.999565:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915889920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892546.000037:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915889664:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892546.000045:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215176:1876834915889792:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892546.000068:0:215176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892546.000262:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892546.000297:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892546.000314:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851008 00000100:00100000:3.0:1789892546.000319:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851008 00010000:00010000:3.0:1789892546.000335:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 10 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.000339:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925850880 00000100:00100000:1.0:1789892546.000346:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925850880 00010000:00010000:1.0:1789892546.000364:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 11 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.000368:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 493 00000100:00100000:3.0:1789892546.000384:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925851008:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892546.000395:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892546.000399:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 494 00010000:00010000:3.0:1789892546.000405:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 11 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.000412:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925850880:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892546.000418:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 11 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.000423:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892546.000431:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 11 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000443:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f600/0x5c4f93dd00213400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a60d expref: 11 pid: 189432 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.000446:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 11 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.000464:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836200/0x5c4f93dd00213407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a614 expref: 10 pid: 189434 timeout: 3471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000470:0:189425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000477:0:189425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.000483:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892546.000487:0:189425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000523:0:189425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.000530:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2400:x1876834925850880:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 120us (233us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892546.000539:0:189425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.000543:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 494 00010000:00010000:3.0:1789892546.000551:0:189425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000560:0:189425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffe00 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:3.0:1789892546.000565:0:189425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000573:0:189425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000591:0:189425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.000615:0:215176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.000626:0:215176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.000633:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffe00/0x5c4f93dd0021348c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.000650:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892546.000681:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925851008:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 302us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.000692:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 493 00000020:00000080:0.0:1789892546.000724:0:215176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd8b41d820 20000000:00000080:0.0:1789892546.000735:0:215176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9069b600f800 uarg=0000000000000000 00000040:00100000:0.0:1789892546.001261:0:215176:0:(llog.c:1072:llog_reverse_process()) index 164 : idx 137 20000000:01000000:0.0:1789892546.001266:0:215176:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 160 cmd:0xce020 lustre.qpool1 00000040:00080000:0.0:1789892546.001304:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].165, 224 off38304 20000000:01000000:0.0:1789892546.001313:0:215176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892546.001323:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].166, 128 off38432 00000040:00080000:0.0:1789892546.001332:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].167, 224 off38656 00000040:00080000:0.0:1789892546.001366:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].191, 224 off43088 20000000:01000000:0.0:1789892546.001372:0:215176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892546.001381:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].192, 136 off43224 00000040:00080000:0.0:1789892546.001390:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].193, 224 off43448 00000040:00080000:0.0:1789892546.001422:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].191, 224 off43088 20000000:01000000:0.0:1789892546.001427:0:215176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892546.001436:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].192, 136 off43224 00000040:00080000:0.0:1789892546.001446:0:215176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].193, 224 off43448 10000000:01000000:0.0:1789892546.001454:0:215176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892546.001463:0:215176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001470:0:215176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001476:0:215176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001480:0:215176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001484:0:215176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001513:0:215176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001518:0:215176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836600 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:0.0:1789892546.001521:0:215176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001526:0:215176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001536:0:215176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001543:0:215176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.001550:0:215176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd00213493 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892546.250645:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892546.250651:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 162 10000000:01000000:3.0:1789892546.250656:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892546.250709:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.250719:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.250728:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.250750:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.250817:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.250860:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.250876:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890048 00000100:00100000:0.0:1789892546.250884:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890048 00000100:00100000:0.0:1789892546.250944:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1789892546.250952:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915890048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.250964:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892546.250976:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021349a expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.250997:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.251037:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.251044:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836600, rc 0) 00000100:00100000:0.0:1789892546.251085:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915890048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.251092:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:3.0:1789892546.251123:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892546.251135:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.251143:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.251221:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.251250:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.251265:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.251285:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890176 00000100:00100000:0.0:1789892546.251290:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890176 00000100:00100000:0.0:1789892546.251311:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1789892546.251316:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915890176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.251410:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915890176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.251415:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1789892546.251439:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.251462:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.251522:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.251539:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.251554:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890304 00000100:00100000:0.0:1789892546.251558:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890304 00000100:00100000:0.0:1789892546.251578:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1789892546.251583:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915890304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.251674:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915890304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.251680:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1789892546.251702:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.251981:0:215177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215177:1876834915890432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.252008:0:215177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.252022:0:215177:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.252045:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890432 00000100:00100000:0.0:1789892546.252048:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890432 00000100:00100000:0.0:1789892546.252069:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:0.0:1789892546.252073:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215177:x1876834915890432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.252153:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215177:x1876834915890432:12345-0@lo:502:llog_process_th.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.252158:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1789892546.252193:0:215177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215177:1876834915890432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.252228:0:215177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215177:1876834915890560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.252252:0:215177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.252266:0:215177:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.252288:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890560 00000100:00100000:0.0:1789892546.252292:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890560 00000100:00100000:0.0:1789892546.252311:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:0.0:1789892546.252316:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215177:x1876834915890560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.252373:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215177:x1876834915890560:12345-0@lo:502:llog_process_th.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.252378:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:3.0:1789892546.252395:0:215177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215177:1876834915890560:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892546.252416:0:215177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:0.0:1789892546.252472:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:0.0:1789892546.252517:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892546.252523:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.252531:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892546.252537:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892546.252539:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789892546.252541:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892546.252553:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.252559:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.252564:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892546.252579:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.252601:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.252623:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890688 00000100:00100000:3.0:1789892546.252628:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890688 00000100:00100000:0.0:1789892546.252631:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a3bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892546.252657:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1789892546.252663:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915890688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892546.252670:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892546.252677:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134a8 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.252697:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.252712:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.252717:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ea00, rc 0) 00000100:00100000:3.0:1789892546.252744:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915890688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.252749:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1789892546.252775:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.252788:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.252794:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892546.252825:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.252845:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.252860:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a3bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.252901:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890816 00000100:00100000:2.0:1789892546.252907:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890816 00000100:00100000:2.0:1789892546.252935:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:2.0:1789892546.252950:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915890816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892546.253019:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915890816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892546.253025:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1789892546.253048:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.253084:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.253111:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.253125:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a3bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892546.253142:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915890944 00000100:00100000:3.0:1789892546.253146:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915890944 00000100:00100000:3.0:1789892546.253167:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1789892546.253195:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915890944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.253258:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915890944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.253265:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1789892546.253281:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915890944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892546.253835:0:215178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:3.0:1789892546.253889:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892546.253920:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892546.253924:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.253930:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892546.253946:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892546.253947:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 162 10000000:01000000:3.0:1789892546.253953:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892546.253964:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.253969:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.253975:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.253983:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.254003:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.254022:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.254047:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891072 00000100:00100000:2.0:1789892546.254051:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891072 00000100:00100000:2.0:1789892546.254073:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1789892546.254077:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915891072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892546.254082:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892546.254090:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134b6 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892546.254112:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892546.254119:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892546.254124:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffec00, rc 0) 00000100:00100000:2.0:1789892546.254150:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915891072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892546.254155:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:3.0:1789892546.254195:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892546.254205:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.254211:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.254239:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.254257:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.254271:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.254287:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891200 00000100:00100000:0.0:1789892546.254291:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891200 00000100:00100000:0.0:1789892546.254312:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1789892546.254317:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915891200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.254372:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915891200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.254386:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.254386:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1789892546.254414:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.254442:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.254456:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.254478:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891328 00000100:00100000:2.0:1789892546.254482:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891328 00000100:00100000:2.0:1789892546.254530:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1789892546.254535:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915891328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892546.254593:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915891328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892546.254599:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:3.0:1789892546.254609:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.254752:0:215179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215179:1876834915891456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.254778:0:215179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.254803:0:215179:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.254803:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891456 00000100:00100000:0.0:1789892546.254810:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891456 00000100:00100000:0.0:1789892546.254841:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1789892546.254848:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215179:x1876834915891456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.254915:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215179:x1876834915891456:12345-0@lo:502:llog_process_th.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.254922:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:3.0:1789892546.254927:0:215179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215179:1876834915891456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.254970:0:215179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215179:1876834915891584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.254995:0:215179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.255009:0:215179:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688349e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.255042:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891584 00000100:00100000:2.0:1789892546.255046:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891584 00000100:00100000:2.0:1789892546.255068:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1789892546.255072:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215179:x1876834915891584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892546.255130:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215179:x1876834915891584:12345-0@lo:502:llog_process_th.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892546.255137:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:3.0:1789892546.255144:0:215179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215179:1876834915891584:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892546.255163:0:215179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:0.0:1789892546.255229:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:0.0:1789892546.255247:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892546.255252:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.255259:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892546.255264:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789892546.255265:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:0.0:1789892546.255267:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892546.255278:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.255283:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.255288:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892546.255298:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.255324:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.255339:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906881b8e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892546.255344:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891712 00000100:00100000:3.0:1789892546.255349:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891712 00000100:00100000:3.0:1789892546.255371:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1789892546.255376:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915891712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892546.255381:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892546.255388:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134c4 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.255399:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.255406:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.255411:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fa00, rc 0) 00000100:00100000:3.0:1789892546.255440:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915891712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.255451:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1789892546.255453:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.255467:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.255473:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892546.255521:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.255540:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.255558:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906881b8e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.255578:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891840 00000100:00100000:2.0:1789892546.255582:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891840 00000100:00100000:2.0:1789892546.255610:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1789892546.255614:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915891840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892546.255667:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915891840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892546.255672:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1789892546.255691:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.255714:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.255743:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.255761:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906881b8e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892546.255771:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915891968 00000100:00100000:3.0:1789892546.255775:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915891968 00000100:00100000:3.0:1789892546.255794:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:3.0:1789892546.255798:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915891968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.255855:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915891968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.255862:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:0.0:1789892546.255874:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915891968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892546.256387:0:215180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789892546.256432:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789892546.256448:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892546.256452:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.256458:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892546.256463:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892546.256464:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 162 10000000:01000000:3.0:1789892546.256466:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892546.256478:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.256483:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.256506:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.256517:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.256543:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.256560:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.256616:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892096 00000100:00100000:2.0:1789892546.256621:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892096 00000100:00100000:2.0:1789892546.256647:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:2.0:1789892546.256653:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915892096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892546.256660:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892546.256668:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134d2 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892546.256680:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892546.256687:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892546.256692:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe400, rc 0) 00000100:00100000:2.0:1789892546.256720:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915892096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892546.256725:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1789892546.256746:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892546.256756:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.256762:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.256789:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.256806:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.256821:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.256844:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892224 00000100:00100000:0.0:1789892546.256848:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892224 00000100:00100000:0.0:1789892546.256871:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:0.0:1789892546.256876:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915892224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.256931:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915892224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.256936:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1789892546.256956:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.256976:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.257003:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.257018:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892546.257045:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892352 00000100:00100000:2.0:1789892546.257050:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892352 00000100:00100000:2.0:1789892546.257079:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1789892546.257089:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915892352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892546.257158:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915892352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.257168:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892546.257186:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1789892546.257347:0:215181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215181:1876834915892480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892546.257376:0:215181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892546.257391:0:215181:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699b173cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.257401:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892480 00000100:00100000:0.0:1789892546.257406:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892480 00000100:00100000:0.0:1789892546.257426:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1789892546.257431:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215181:x1876834915892480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.257507:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215181:x1876834915892480:12345-0@lo:502:llog_process_th.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.257514:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:2.0:1789892546.257524:0:215181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215181:1876834915892480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892546.257561:0:215181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215181:1876834915892608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892546.257596:0:215181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.257624:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892608 00000100:00100000:2.0:1789892546.257627:0:215181:0:(client.c:2702:ptlrpc_set_wait()) set ffff906998af73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.257628:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892608 00000100:00100000:0.0:1789892546.257655:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:0.0:1789892546.257662:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215181:x1876834915892608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.257736:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215181:x1876834915892608:12345-0@lo:502:llog_process_th.0 Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.257744:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:2.0:1789892546.257765:0:215181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215181:1876834915892608:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892546.257784:0:215181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:3.0:1789892546.257837:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:3.0:1789892546.257855:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892546.257860:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.257878:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892546.257883:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892546.257889:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 188 10000000:01000000:3.0:1789892546.257891:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892546.257902:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.257907:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.257912:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.257920:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.257938:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.257952:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.257971:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892736 00000100:00100000:0.0:1789892546.257986:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892736 00000100:00100000:0.0:1789892546.258016:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1789892546.258023:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915892736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.258031:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892546.258040:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134e0 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.258067:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.258076:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.258095:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837e00, rc 0) 00000100:00100000:0.0:1789892546.258139:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915892736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.258147:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1789892546.258157:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892546.258167:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.258191:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892546.258218:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.258235:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.258247:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.258257:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892864 00000100:00100000:0.0:1789892546.258263:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892864 00000100:00100000:0.0:1789892546.258289:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:0.0:1789892546.258296:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915892864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.258367:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915892864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.258374:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1789892546.258379:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.258398:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.258424:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.258443:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.258445:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915892992 00000100:00100000:0.0:1789892546.258449:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915892992 00000100:00100000:0.0:1789892546.258468:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1789892546.258473:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915892992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.258553:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915892992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.258559:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1789892546.258581:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915892992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.258765:0:215182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215182:1876834915893120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.258790:0:215182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.258811:0:215182:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.258815:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893120 00000100:00100000:0.0:1789892546.258821:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893120 00000100:00100000:0.0:1789892546.258851:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:0.0:1789892546.258860:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215182:x1876834915893120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.258956:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215182:x1876834915893120:12345-0@lo:502:llog_process_th.0 Request processed in 97us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.258965:0:215182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215182:1876834915893120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.258966:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000020:01000000:3.0:1789892546.258985:0:215182:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892546.258995:0:215182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892546.259008:0:215182:0:(obd_config.c:1561:class_process_config()) marker 178 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:3.0:1789892546.259013:0:215182:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1789892546.259027:0:215182:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to qpool1 as member 1 00000020:01000000:3.0:1789892546.259031:0:215182:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892546.259032:0:215182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892546.259033:0:215182:0:(obd_config.c:1561:class_process_config()) marker 178 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0000_UUID 00000020:01000000:3.0:1789892546.259035:0:215182:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892546.259037:0:215182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892546.259038:0:215182:0:(obd_config.c:1561:class_process_config()) marker 181 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:3.0:1789892546.259039:0:215182:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1789892546.259042:0:215182:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 2 00000100:00100000:3.0:1789892546.259053:0:215182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215182:1876834915893248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.259078:0:215182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.259091:0:215182:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.259101:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893248 00000100:00100000:0.0:1789892546.259106:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893248 00000100:00100000:0.0:1789892546.259134:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1789892546.259141:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215182:x1876834915893248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.259236:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215182:x1876834915893248:12345-0@lo:502:llog_process_th.0 Request processed in 94us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.259244:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:3.0:1789892546.259247:0:215182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215182:1876834915893248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892546.259269:0:215182:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892546.259272:0:215182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892546.259274:0:215182:0:(obd_config.c:1561:class_process_config()) marker 181 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892546.259276:0:215182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 194 count 190 00000020:01000000:1.0:1789892546.259323:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 188-193 (rc=0) 10000000:01000000:1.0:1789892546.259341:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892546.259346:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.259354:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892546.259360:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892546.259362:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 162 10000000:01000000:1.0:1789892546.259363:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892546.259378:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.259386:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.259393:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.259409:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915893376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.259441:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.259458:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.259472:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893376 00000100:00100000:0.0:1789892546.259476:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893376 00000100:00100000:0.0:1789892546.259521:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1789892546.259528:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915893376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.259534:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892546.259541:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134ee expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.259552:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.259558:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.259563:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892546.259588:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915893376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.259593:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:1.0:1789892546.259605:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915893376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892546.259617:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.259623:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.259662:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915893504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.259681:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892546.259702:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893504 00000100:00100000:0.0:1789892546.259706:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893504 00000100:00100000:1.0:1789892546.259708:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.259728:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1789892546.259734:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915893504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.259810:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915893504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.259817:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1789892546.259820:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915893504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.259851:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915893632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.259881:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.259900:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.259900:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893632 00000100:00100000:0.0:1789892546.259905:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893632 00000100:00100000:0.0:1789892546.259923:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1789892546.259927:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915893632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.259983:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915893632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.259989:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1789892546.260012:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915893632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.260197:0:215183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215183:1876834915893760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.260225:0:215183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.260245:0:215183:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.260248:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893760 00000100:00100000:0.0:1789892546.260253:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893760 00000100:00100000:0.0:1789892546.260273:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:0.0:1789892546.260279:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215183:x1876834915893760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.260338:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215183:x1876834915893760:12345-0@lo:502:llog_process_th.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.260343:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:3.0:1789892546.260352:0:215183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215183:1876834915893760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.260383:0:215183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215183:1876834915893888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.260408:0:215183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.260421:0:215183:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.260426:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915893888 00000100:00100000:0.0:1789892546.260430:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915893888 00000100:00100000:0.0:1789892546.260449:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:0.0:1789892546.260455:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215183:x1876834915893888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.260535:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215183:x1876834915893888:12345-0@lo:502:llog_process_th.0 Request processed in 80us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.260540:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1789892546.260549:0:215183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215183:1876834915893888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892546.260568:0:215183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:1.0:1789892546.260608:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:1.0:1789892546.260631:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892546.260635:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.260641:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892546.260646:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892546.260647:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 188 10000000:01000000:1.0:1789892546.260649:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892546.260660:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.260665:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.260670:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.260684:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.260706:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.260726:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.260729:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894016 00000100:00100000:0.0:1789892546.260733:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894016 00000100:00100000:0.0:1789892546.260771:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1789892546.260780:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915894016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.260787:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892546.260794:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002134fc expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.260805:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.260811:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.260815:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837a00, rc 0) 00000100:00100000:0.0:1789892546.260842:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915894016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.260848:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1789892546.260856:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892546.260868:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.260874:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.260899:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.260917:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.260929:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.260937:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894144 00000100:00100000:0.0:1789892546.260940:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894144 00000100:00100000:0.0:1789892546.260961:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1789892546.260967:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915894144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892546.261025:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915894144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.261031:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1789892546.261036:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.261065:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.261093:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.261107:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892546.261125:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894272 00000100:00100000:3.0:1789892546.261129:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894272 00000100:00100000:3.0:1789892546.261152:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1789892546.261158:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915894272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.261231:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915894272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.261237:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1789892546.261248:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.261409:0:215184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215184:1876834915894400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892546.261435:0:215184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.261449:0:215184:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.261456:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894400 00000100:00100000:0.0:1789892546.261460:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894400 00000100:00100000:0.0:1789892546.261481:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:0.0:1789892546.261486:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215184:x1876834915894400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892546.261576:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215184:x1876834915894400:12345-0@lo:502:llog_process_th.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.261586:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1789892546.261589:0:215184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215184:1876834915894400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892546.261611:0:215184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892546.261616:0:215184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892546.261617:0:215184:0:(obd_config.c:1561:class_process_config()) marker 177 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:3.0:1789892546.261621:0:215184:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1789892546.261628:0:215184:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to qpool1 as member 1 00000020:01000000:0.0:1789892546.261867:0:215184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892546.261872:0:215184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892546.261873:0:215184:0:(obd_config.c:1561:class_process_config()) marker 177 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0000_UUID 00000020:01000000:0.0:1789892546.261876:0:215184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789892546.261877:0:215185:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789892546.261880:0:215185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000020:00000080:0.0:1789892546.261881:0:215184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892546.261884:0:215184:0:(obd_config.c:1561:class_process_config()) marker 180 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:0.0:1789892546.261888:0:215184:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789892546.261895:0:215184:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 2 00000100:00100000:3.0:1789892546.262150:0:215184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215184:1876834915894528:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789892546.262152:0:215186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789892546.262155:0:215186:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:3.0:1789892546.262214:0:215184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892546.262244:0:215184:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892546.262271:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894528 00000100:00100000:1.0:1789892546.262277:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894528 00000100:00100000:1.0:1789892546.262312:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1789892546.262322:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215184:x1876834915894528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892546.262398:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215184:x1876834915894528:12345-0@lo:502:llog_process_th.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892546.262404:0:215184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215184:1876834915894528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892546.262419:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000020:01000000:3.0:1789892546.262425:0:215184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892546.262430:0:215184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892546.262446:0:215184:0:(obd_config.c:1561:class_process_config()) marker 180 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892546.262450:0:215184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 194 count 190 00000020:01000000:1.0:1789892546.262518:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 188-193 (rc=0) 10000000:01000000:1.0:1789892546.262545:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892546.262550:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.262558:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892546.262564:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892546.262566:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:1.0:1789892546.262567:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892546.262578:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.262583:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.262589:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.262598:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.262618:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.262639:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892546.262644:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894656 00000100:00100000:0.0:1789892546.262650:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894656 00000100:00100000:0.0:1789892546.262676:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1789892546.262681:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915894656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892546.262687:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892546.262694:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021350a expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.262705:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.262711:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892546.262716:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892546.262747:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915894656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892546.262754:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1789892546.262761:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892546.262772:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.262787:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892546.262815:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892546.262834:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.262848:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e729f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892546.262856:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894784 00000100:00100000:3.0:1789892546.262861:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894784 00000100:00100000:3.0:1789892546.262885:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:3.0:1789892546.262892:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915894784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892546.262939:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915894784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (102us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892546.262944:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1789892546.262949:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915894784:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789892546.262971:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892546.262975:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892546.262980:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892546.338649:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892546.338690:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789892546.338708:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915894912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892546.338769:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.338832:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915894912 00000100:00100000:1.0:1789892546.338841:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915894912 00000100:00100000:1.0:1789892546.338892:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789892546.338899:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915894912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892546.338941:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892546.338985:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915894912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892546.338991:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789892546.339035:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915894912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892546.850773:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915895040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892546.850859:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892546.850917:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895040 00000100:00100000:1.0:1789892546.850929:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895040 00000100:00100000:1.0:1789892546.850989:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789892546.851000:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915895040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789892546.851057:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:1.0:1789892546.851119:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915895040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892546.851129:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789892546.851185:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915895040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892547.215377:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892547.215422:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851136 00000100:00100000:2.0:1789892547.215431:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851136 00000100:00100000:2.0:1789892547.215477:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2109 00000100:00100000:2.0:1789892547.215487:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925851136:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.215523:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.215538:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a61b expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.215563:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.215573:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.215580:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffc00, rc 0) 00000100:00100000:2.0:1789892547.215633:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925851136:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 148us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.215640:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2109 00000100:00100000:3.0:1789892547.216289:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892547.216334:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851264 00000100:00100000:0.0:1789892547.216341:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851264 00000100:00100000:0.0:1789892547.216377:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2110 00000100:00100000:0.0:1789892547.216387:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925851264:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.216727:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925851264:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 339us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.216737:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2110 00000100:00100000:3.0:1789892547.217195:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892547.217248:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851392 00000100:00100000:2.0:1789892547.217253:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851392 00000100:00100000:2.0:1789892547.217283:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2111 00000100:00100000:2.0:1789892547.217301:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925851392:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.217374:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925851392:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.217380:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2111 00000100:00100000:3.0:1789892547.218286:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892547.218318:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851520 00000100:00100000:0.0:1789892547.218323:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851520 00000100:00100000:0.0:1789892547.218352:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2112 00000100:00100000:0.0:1789892547.218360:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213920:x1876834925851520:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892547.218447:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213920:x1876834925851520:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 85us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.218456:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2112 00000100:00100000:3.0:1789892547.219109:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892547.219140:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851648 00000100:00100000:2.0:1789892547.219144:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851648 00000100:00100000:2.0:1789892547.219182:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2113 00000100:00100000:2.0:1789892547.219200:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213920:x1876834925851648:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892547.219253:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213920:x1876834925851648:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.219258:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2113 00000100:00100000:3.0:1789892547.220033:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892547.220060:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851776 00000100:00100000:0.0:1789892547.220065:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851776 00000100:00100000:0.0:1789892547.220089:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2114 00000100:00100000:0.0:1789892547.220095:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925851776:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892547.220101:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892547.220110:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a622 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.220132:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.220139:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.220144:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836800, rc 0) 00000100:00100000:0.0:1789892547.220183:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925851776:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.220189:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2114 00000100:00100000:3.0:1789892547.220651:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892547.220676:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925851904 00000100:00100000:2.0:1789892547.220681:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925851904 00000100:00100000:2.0:1789892547.220706:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2115 00000100:00100000:2.0:1789892547.220711:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925851904:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.220753:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925851904:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 40us (101us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892547.220758:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2115 00000100:00100000:1.0:1789892547.362631:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915895168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789892547.362636:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892547.362683:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915895296:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.362726:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892547.362759:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.362776:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915895680:0@lo:400:kworker.0 00000100:00100000:0.0:1789892547.362796:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895296 00000100:00100000:0.0:1789892547.362805:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895296 00000100:00100000:3.0:1789892547.362819:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915895808:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.362823:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.362861:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915896192:0@lo:400:kworker.0 00000100:00100000:0.0:1789892547.362863:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1789892547.362866:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.362879:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915895296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.362901:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915896320:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.362906:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.362937:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915896704:0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.362941:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.362944:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895680 00000100:00100000:0.0:1789892547.362946:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915895296:12345-0@lo:400:kworker.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.362956:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895680 00000100:00100000:0.0:1789892547.362957:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1789892547.362974:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915896832:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.362974:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363005:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896192 00000100:00100000:1.0:1789892547.363006:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915897216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892547.363009:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896192 00000100:00100000:3.0:1789892547.363016:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363046:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789892547.363047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363057:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915895680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.363063:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915895296:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.363076:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789892547.363084:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915895552:0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.363089:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789892547.363101:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915895424:0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.363108:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915895680:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.363116:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363118:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789892547.363135:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895552 00000100:00100000:2.0:1789892547.363138:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895552 00000100:00100000:1.0:1789892547.363142:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915896064:0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.363163:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363176:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789892547.363184:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915896192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.363221:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915895936:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.363221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.363252:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1876834915896576:0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.363261:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915896192:12345-0@lo:400:kworker.0 Request processed in 76us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.363268:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789892547.363282:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363286:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896064 00000100:00100000:2.0:1789892547.363292:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896064 00000100:00100000:1.0:1789892547.363298:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892547.363326:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915896448:0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.363332:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892547.363334:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915897088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892547.363348:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915895552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.363376:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892547.363426:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.363436:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915895552:12345-0@lo:400:kworker.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.363445:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892547.363445:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915896192:0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.363461:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915896960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892547.363479:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789892547.363491:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915895680:0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.363495:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a5e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915896064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.363526:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915895552:0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.363571:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.363593:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895808 00000100:00100000:1.0:1789892547.363599:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895808 00000100:00100000:2.0:1789892547.363619:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a5e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915896064:12345-0@lo:400:kworker.0 Request processed in 126us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.363632:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789892547.363639:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896320 00000100:00100000:1.0:1789892547.363639:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896704 00000100:00100000:1.0:1789892547.363646:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896704 00000100:00100000:3.0:1789892547.363651:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896320 00000100:00100000:1.0:1789892547.363670:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896832 00000100:00100000:1.0:1789892547.363675:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896832 00000100:00100000:2.0:1789892547.363705:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895168 00000100:00100000:3.0:1789892547.363709:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896576 00000100:00100000:2.0:1789892547.363711:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895168 00000100:00100000:3.0:1789892547.363715:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896576 00000100:00100000:1.0:1789892547.363715:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896448 00000100:00100000:1.0:1789892547.363722:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896448 00000100:00100000:3.0:1789892547.363753:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1789892547.363759:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915897216 00000100:00100000:1.0:1789892547.363764:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1789892547.363766:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915897216 00000100:00100000:3.0:1789892547.363767:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915895808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892547.363767:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915897088 00000100:00100000:0.0:1789892547.363774:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915897088 00000100:00100000:1.0:1789892547.363780:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915896704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.363788:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915896960 00000100:00100000:2.0:1789892547.363793:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915896960 00000100:00100000:0.0:1789892547.363805:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789892547.363817:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915895168:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892547.363821:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915895808:12345-0@lo:400:kworker.0 Request processed in 58us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.363825:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789892547.363841:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915896704:12345-0@lo:400:kworker.0 Request processed in 65us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.363842:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00002000:00000024:0.0:1789892547.363842:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892547.363843:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915897216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892547.363856:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1789892547.363871:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00002000:00000024:2.0:1789892547.363872:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892547.363880:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1789892547.363885:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915896320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892547.363890:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915895168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.363894:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915896832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892547.363908:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789892547.363918:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915897216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.363926:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789892547.363933:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789892547.363940:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915896320:12345-0@lo:400:kworker.0 Request processed in 62us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.363948:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915896832:12345-0@lo:400:kworker.0 Request processed in 58us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.363952:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789892547.363953:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1789892547.363954:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915897088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892547.363964:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789892547.363969:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915896960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789892547.363971:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892547.363980:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00002000:00000024:2.0:1789892547.363981:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892547.363988:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1789892547.363994:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876834915896576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.364000:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915896448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892547.364019:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915897088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.364028:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915896960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.364029:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789892547.364040:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789892547.364053:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876834915896576:12345-0@lo:400:kworker.0 Request processed in 61us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.364054:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915896448:12345-0@lo:400:kworker.0 Request processed in 57us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.364073:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789892547.364085:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789892547.364113:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895424 00000100:00100000:2.0:1789892547.364121:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895424 00000100:00100000:1.0:1789892547.364131:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915895936 00000100:00100000:1.0:1789892547.364143:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915895936 00000100:00100000:3.0:1789892547.364148:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915896448:0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.364181:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789892547.364189:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789892547.364210:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915896960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892547.364213:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915895424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.364220:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915895936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.364241:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915895808:0@lo:400:kworker.0 00000100:00100000:3.0:1789892547.364260:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915896320:0@lo:400:kworker.0 00010000:00080000:3.0:1789892547.364285:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688243ad80 x1876834915896832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892547.364292:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915895936:12345-0@lo:400:kworker.0 Request processed in 92us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.364303:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915895424:12345-0@lo:400:kworker.0 Request processed in 108us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.364316:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789892547.364329:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915896832:0@lo:400:kworker.0 00000100:00100000:2.0:1789892547.364330:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:2.0:1789892547.364375:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892547.364395:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915896064:0@lo:400:kworker.0 00000100:00080000:2.0:1789892547.364397:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789892547.364402:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892547.364408:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915895424:0@lo:400:kworker.0 00000100:00080000:2.0:1789892547.364413:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789892547.364417:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906882439f80 x1876834915896576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892547.364429:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915895936:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.364434:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1876834915896576:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.364487:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915897088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892547.364515:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915897216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892547.364583:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915896704:0@lo:400:kworker.0 00000100:00100000:1.0:1789892547.364611:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915895168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892547.371040:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892547.371128:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852032 00000100:00100000:3.0:1789892547.371144:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852032 00000100:00100000:3.0:1789892547.371229:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2794 00000100:00100000:3.0:1789892547.371242:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:213930:x1876834925852032:12345-192.168.204.33@tcp:48:lfs.0 00000100:00080000:2.0:1789892547.371410:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892547.373302:0:189439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:189439:1876834915897344:0@lo:19:mdt00_001.0 00000100:00100000:2.0:1789892547.373355:0:189439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.373403:0:189439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:189439:1876834915897472:0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892547.373417:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915897344 00000100:00100000:3.0:1789892547.373424:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915897344 00000100:00100000:2.0:1789892547.373433:0:189439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.373471:0:189439:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699156f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892547.373483:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915897472 00000100:00100000:3.0:1789892547.373488:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915897472 00000100:00100000:2.0:1789892547.373500:0:190942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789892547.373511:0:190942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:189439:x1876834915897344:12345-0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892547.373552:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789892547.373564:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:189439:x1876834915897472:12345-0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892547.373803:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:189439:x1876834915897472:12345-0@lo:19:mdt00_001.0 Request processed in 241us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.373808:0:190942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:189439:x1876834915897344:12345-0@lo:19:mdt00_001.0 Request processed in 297us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.373818:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789892547.373827:0:190942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789892547.373870:0:189439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:189439:1876834915897344:0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892547.373883:0:189439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:189439:1876834915897472:0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892547.373978:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:213930:x1876834925852032:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 2738us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.373988:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2794 00000100:00100000:2.0:1789892547.375025:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892547.375049:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852160 00000100:00100000:2.0:1789892547.375054:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852160 00000100:00100000:2.0:1789892547.375093:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2795 00000100:00100000:2.0:1789892547.375102:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688243ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:213930:x1876834925852160:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:2.0:1789892547.376964:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688243ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:213930:x1876834925852160:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1863us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.376971:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2795 00000020:00000080:2.0:1789892547.659829:0:215286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff441ed300 20000000:00000080:2.0:1789892547.659843:0:215286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90688d4a4400 uarg=0000000000000000 00000040:00100000:2.0:1789892547.660330:0:215286:0:(llog.c:1072:llog_reverse_process()) index 167 : idx 137 20000000:01000000:2.0:1789892547.660336:0:215286:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 157 cmd:0xce023 lustre.qpool2 00000040:00080000:2.0:1789892547.660408:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].168, 224 off38880 20000000:01000000:2.0:1789892547.660426:0:215286:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789892547.660436:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].169, 104 off38984 00000040:00080000:2.0:1789892547.660455:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].170, 224 off39208 00000040:00080000:2.0:1789892547.660520:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].194, 224 off43672 20000000:01000000:2.0:1789892547.660529:0:215286:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789892547.660542:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].195, 112 off43784 00000040:00080000:2.0:1789892547.660554:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].196, 224 off44008 00000040:00080000:2.0:1789892547.660591:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].194, 224 off43672 20000000:01000000:2.0:1789892547.660597:0:215286:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789892547.660605:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].195, 112 off43784 00000040:00080000:2.0:1789892547.660615:0:215286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].196, 224 off44008 10000000:01000000:2.0:1789892547.660623:0:215286:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892547.660638:0:215286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660652:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660658:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660662:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660667:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660671:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660675:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660680:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660690:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660694:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660701:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660706:0:215286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660711:0:215286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660742:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660753:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 9 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.660765:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897600:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892547.660862:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660869:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 9 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.660876:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882438380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897728:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892547.660910:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660916:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 23 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.660923:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897856:0@lo:104: 00000100:00100000:2.0:1789892547.660954:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892547.660981:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.660988:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 23 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.660990:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915897856 00000100:00100000:2.0:1789892547.660998:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897984:0@lo:104: 00000100:00100000:0.0:1789892547.660999:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915897856 00000100:00100000:2.0:1789892547.661017:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892547.661042:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.661047:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915897984 00010000:00010000:2.0:1789892547.661050:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 23 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.661051:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915897984 00000100:00100000:2.0:1789892547.661061:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898112:0@lo:104: 00000100:00100000:0.0:1789892547.661078:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1789892547.661083:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.661090:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915897856:12345-0@lo:104: 00000100:00100000:1.0:1789892547.661097:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00010000:00010000:0.0:1789892547.661105:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.661108:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.661118:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688243b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915897984:12345-0@lo:104: 00000100:00100000:3.0:1789892547.661119:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898112 00010000:00010000:2.0:1789892547.661125:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 23 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661127:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898112 00010000:00010000:1.0:1789892547.661137:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661167:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898240:0@lo:104: 00010000:00010000:0.0:1789892547.661182:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892547.661190:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215286:x1876834915897856:12345-0@lo:104: Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.661196:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1789892547.661207:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892547.661209:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215286:x1876834915898112:12345-0@lo:104: 00000100:00100000:2.0:1789892547.661215:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892547.661222:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661230:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892547.661233:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898240 00000100:00100000:0.0:1789892547.661238:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898240 00000100:00100000:1.0:1789892547.661240:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688243b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915897984:12345-0@lo:104: Request processed in 130us (219us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892547.661242:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.661255:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00010000:00010000:2.0:1789892547.661262:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 23 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.661267:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1789892547.661267:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215286:x1876834915898240:12345-0@lo:104: 00010000:00010000:0.0:1789892547.661281:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661282:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882600700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898368:0@lo:104: 00010000:00010000:1.0:1789892547.661306:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892547.661311:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892547.661320:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898112:12345-0@lo:104: Request processed in 115us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892547.661323:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661328:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892547.661335:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789892547.661346:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801c00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892547.661347:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898240:12345-0@lo:104: Request processed in 82us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.661349:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 10000000:00010000:1.0:1789892547.661354:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.661356:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.661371:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00010000:00010000:2.0:1789892547.661382:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 23 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661384:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.661387:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898368 00000100:00100000:0.0:1789892547.661393:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898368 00000100:00100000:2.0:1789892547.661396:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882603800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898496:0@lo:104: 10000000:00010000:1.0:1789892547.661401:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892547.661410:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892547.661417:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1789892547.661423:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.661430:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215286:x1876834915898368:12345-0@lo:104: 00010000:00010000:0.0:1789892547.661438:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.661445:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661448:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898496 00010000:00010000:1.0:1789892547.661451:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661454:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898496 00010000:00010000:2.0:1789892547.661456:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 23 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661474:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892547.661475:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789892547.661476:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789892547.661479:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882603480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898624:0@lo:104: 00000100:00100000:0.0:1789892547.661488:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898368:12345-0@lo:104: Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.661510:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898496:12345-0@lo:104: 00010000:00010000:3.0:1789892547.661519:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661536:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892547.661565:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789892547.661571:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898496:12345-0@lo:104: Request processed in 84us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.661578:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00010000:00010000:2.0:1789892547.661595:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661599:0:189423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789892547.661604:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789892547.661611:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898624 00000100:00100000:3.0:1789892547.661615:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898624 00010000:00010000:2.0:1789892547.661630:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 23 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.661632:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789892547.661642:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661643:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789892547.661650:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898880:0@lo:104: 00000100:00100000:3.0:1789892547.661654:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906998c77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215286:x1876834915898624:12345-0@lo:104: 00010000:00010000:0.0:1789892547.661662:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801a00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892547.661665:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892547.661668:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661672:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.661693:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661697:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892547.661697:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd0021350a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213511 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.661699:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789892547.661712:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906998c77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215286:x1876834915898624:12345-0@lo:104: Request processed in 58us (177us total) trans 0 rc 0/0 10000000:00010000:0.0:1789892547.661716:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661728:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00010000:00010000:2.0:1789892547.661729:0:215286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661729:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 10000000:01000000:0.0:1789892547.661731:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892547.661738:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.661754:0:215286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 23 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661754:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892547.661759:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892547.661762:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661781:0:215286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915899008:0@lo:104: 00010000:00010000:0.0:1789892547.661804:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892547.661809:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.661817:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661818:0:215286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892547.661832:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.661834:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801a00/0x5c4f93dd002134fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213503 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661839:0:215286:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789892547.661848:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898880 10000000:01000000:1.0:1789892547.661853:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892547.661855:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898880 00010000:00010000:0.0:1789892547.661862:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789892547.661867:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897856:0@lo:104: 00010000:00010000:0.0:1789892547.661869:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661877:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661881:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899008 00010000:00010000:0.0:1789892547.661881:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878fe00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892547.661886:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899008 00000100:00100000:2.0:1789892547.661886:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897984:0@lo:104: 10000000:00010000:0.0:1789892547.661890:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661896:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892547.661905:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898112:0@lo:104: 00010000:00010000:0.0:1789892547.661907:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.661916:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 10000000:00010000:0.0:1789892547.661918:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.661922:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661923:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898240:0@lo:104: 00000100:00100000:3.0:1789892547.661927:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898880:12345-0@lo:104: 10000000:01000000:0.0:1789892547.661939:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892547.661944:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882600700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898368:0@lo:104: 00010000:00010000:1.0:1789892547.661945:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002134ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134f5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661960:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882603800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898496:0@lo:104: 00010000:00010000:1.0:1789892547.661963:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892547.661963:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.661972:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882603480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898624:0@lo:104: 00010000:00010000:1.0:1789892547.661973:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.661976:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892547.661989:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f000 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892547.661994:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892547.661995:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662009:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662020:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd002134e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134e7 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662022:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662023:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892547.662033:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892547.662048:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662050:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892547.662051:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837400 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892547.662051:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892547.662056:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.662057:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215286:x1876834915898880:12345-0@lo:104: Request processed in 134us (366us total) trans 0 rc 0/0 10000000:00010000:2.0:1789892547.662068:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.662077:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:0.0:1789892547.662078:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ee00 already unused, calling callback (ffffffffc112ec20) 10000000:01000000:1.0:1789892547.662083:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892547.662085:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.662096:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00010000:00010000:2.0:1789892547.662096:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662100:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.662108:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215286:x1876834915899008:12345-0@lo:104: 00010000:00010000:1.0:1789892547.662112:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892547.662121:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662123:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892547.662124:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662132:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789892547.662143:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892547.662159:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892547.662166:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892547.662173:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002134d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134d9 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662184:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662189:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892547.662193:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892547.662194:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892547.662195:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662196:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662204:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.662208:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215286:x1876834915899008:12345-0@lo:104: Request processed in 100us (391us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892547.662219:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892547.662222:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836c00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892547.662226:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd002134b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134bd expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892547.662230:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662232:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662236:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892547.662242:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662254:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662259:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002134c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134cb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892547.662269:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662280:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f600 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892547.662286:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 10000000:00010000:0.0:1789892547.662287:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662294:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892547.662294:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892547.662298:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662299:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892547.662306:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789892547.662307:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892547.662312:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892547.662318:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662319:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892547.662327:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892547.662328:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892547.662330:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662335:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892547.662343:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662350:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662350:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f600/0x5c4f93dd0021349a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134a1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.662361:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915898880:0@lo:104: 00010000:00010000:0.0:1789892547.662366:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892547.662372:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892547.662374:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836c00/0x5c4f93dd002134a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002134af expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662376:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892547.662382:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915899008:0@lo:104: 00010000:00010000:1.0:1789892547.662398:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892547.662402:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892547.662403:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915898752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892547.662406:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892547.662425:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897600:192.168.204.33@tcp:104: 00000100:00100000:1.0:1789892547.662426:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915899136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.662427:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892547.662452:0:215286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882438380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215286:1876834915897728:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892547.662466:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915899392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.662476:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892547.662524:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852288 00000100:00100000:0.0:1789892547.662530:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.662531:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852288 00000100:00100000:3.0:1789892547.662544:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852416 00000100:00100000:3.0:1789892547.662549:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852416 00010000:00010000:1.0:1789892547.662561:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 11 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.662563:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915900032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892547.662568:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 11 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.662600:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.662601:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899392 00000100:00100000:1.0:1789892547.662607:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899392 00000100:00100000:3.0:1789892547.662610:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900032 00000100:00100000:3.0:1789892547.662615:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900032 00000100:00100000:0.0:1789892547.662629:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:1.0:1789892547.662631:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 25 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662633:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 25 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.662639:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915899264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892547.662670:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.662676:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 495 00000100:00100000:0.0:1789892547.662685:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915899776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.662686:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 496 00000100:00100000:1.0:1789892547.662693:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925852288:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.662701:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925852416:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892547.662709:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892547.662710:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892547.662715:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892547.662723:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 11 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662724:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 11 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662747:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 11 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.662748:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899264 00000100:00100000:0.0:1789892547.662753:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899264 00010000:00010000:1.0:1789892547.662765:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 11 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662771:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 26 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.662790:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899776 00000100:00100000:0.0:1789892547.662794:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899776 00010000:00010000:3.0:1789892547.662797:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836800/0x5c4f93dd0021351f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a622 expref: 11 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.662797:0:215286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662801:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffc00/0x5c4f93dd00213518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a61b expref: 11 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.662804:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 27 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662822:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892547.662833:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00010000:00010000:1.0:1789892547.662839:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892547.662843:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915899392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892547.662851:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892547.662855:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 27 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.662866:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2399:x1876834925852416:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 164us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.662867:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892547.662867:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 27 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.662877:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2400:x1876834925852288:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 188us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.662889:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 496 00010000:00010000:0.0:1789892547.662893:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837e00/0x5c4f93dd002134e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134e0 expref: 27 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.662894:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915899520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892547.662901:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 495 00000100:00100000:3.0:1789892547.662905:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915898752 00000100:00100000:3.0:1789892547.662911:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915898752 00010000:00010000:0.0:1789892547.662913:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892547.662929:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.662936:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1789892547.662941:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.662953:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915900032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892547.662960:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915899392:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.662963:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899520 00010000:00010000:1.0:1789892547.662966:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892547.662967:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915899904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.662969:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899520 00000100:00100000:0.0:1789892547.662970:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00010000:00010000:1.0:1789892547.662978:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 28 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.662991:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.662994:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.662994:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1789892547.663007:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915899264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892547.663010:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892547.663023:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892547.663024:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd002134a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021349a expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663031:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.663032:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899904 00000100:00100000:3.0:1789892547.663037:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899904 00010000:00010000:0.0:1789892547.663048:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.663055:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892547.663060:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 27 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663063:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd002134f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134ee expref: 27 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.663071:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00010000:00010000:0.0:1789892547.663085:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892547.663089:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915899776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.663094:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1789892547.663100:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915900032:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (498us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892547.663108:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892547.663109:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3621:x1876834915898752:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892547.663114:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1789892547.663116:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915899264:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (445us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892547.663121:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 26 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663126:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892547.663128:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:3.0:1789892547.663134:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 25 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.663162:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 24 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.663162:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789892547.663173:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789892547.663178:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915899520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892547.663182:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 24 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.663190:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915899904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892547.663194:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892547.663201:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892547.663203:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fa00/0x5c4f93dd002134cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134c4 expref: 24 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.663204:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 24 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663206:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837600/0x5c4f93dd00213511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021350a expref: 24 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663211:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 24 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.663239:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 22 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663258:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 22 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.663266:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892547.663267:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892547.663276:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe400/0x5c4f93dd002134d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134d2 expref: 22 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663279:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ea00/0x5c4f93dd002134af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134a8 expref: 22 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.663292:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892547.663296:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892547.663316:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3620:x1876834915899776:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892547.663322:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3621:x1876834915898752:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.663331:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789892547.663339:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1789892547.663352:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915899520:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.663352:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915899904:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.663367:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789892547.663375:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1789892547.663394:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915898752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892547.663408:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915899264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892547.663416:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915899520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892547.663426:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.663432:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915899776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892547.663440:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915899904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892547.663447:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915899392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892547.663460:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915899648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892547.663463:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915900032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892547.663521:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.663545:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899136 00000100:00100000:2.0:1789892547.663551:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899136 00000100:00100000:3.0:1789892547.663563:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915899648 00000100:00100000:3.0:1789892547.663568:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915899648 00010000:00010000:2.0:1789892547.663575:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 18 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663584:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 18 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.663610:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1789892547.663618:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1789892547.663624:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915899136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.663629:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915899648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892547.663637:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892547.663639:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892547.663648:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 18 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.663649:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 18 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.663668:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 18 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663682:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 18 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.663696:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837a00/0x5c4f93dd00213503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134fc expref: 18 pid: 189432 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663699:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002134bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002134b6 expref: 18 pid: 189434 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663720:0:199151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663727:0:199151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.663733:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892547.663736:0:199151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663742:0:199151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663747:0:199151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663753:0:199151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663758:0:199151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:3.0:1789892547.663763:0:199151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663771:0:199151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892547.663778:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3622:x1876834915899136:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.663792:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1789892547.663803:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915899136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892547.663813:0:199151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892547.663827:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892547.663834:0:215286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663845:0:215286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.663853:0:215286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213526 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892547.663870:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915899648:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.663879:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915899648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892547.663882:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 10000000:01000000:0.0:1789892547.970614:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892547.970622:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 168 10000000:01000000:0.0:1789892547.970629:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892547.970682:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.970696:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.970733:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.970763:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.970840:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.970899:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.970910:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900160 00000100:00100000:2.0:1789892547.970920:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900160 00000100:00100000:2.0:1789892547.970985:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1789892547.970996:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915900160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.971011:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.971028:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021352d expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.971066:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.971079:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.971090:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff000, rc 0) 00000100:00100000:2.0:1789892547.971134:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915900160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.971154:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1789892547.971183:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892547.971198:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.971206:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.971259:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.971283:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.971302:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.971323:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900288 00000100:00100000:2.0:1789892547.971328:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900288 00000100:00100000:2.0:1789892547.971349:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1789892547.971353:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915900288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.971448:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915900288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.971453:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1789892547.971485:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.971525:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.971558:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.971587:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.971592:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900416 00000100:00100000:2.0:1789892547.971597:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900416 00000100:00100000:2.0:1789892547.971618:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1789892547.971622:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915900416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.971691:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915900416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.971699:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1789892547.971723:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.972022:0:215287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215287:1876834915900544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.972052:0:215287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.972080:0:215287:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.972093:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900544 00000100:00100000:2.0:1789892547.972098:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900544 00000100:00100000:2.0:1789892547.972124:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:2.0:1789892547.972129:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215287:x1876834915900544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.972212:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215287:x1876834915900544:12345-0@lo:502:llog_process_th.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.972218:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1789892547.972243:0:215287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215287:1876834915900544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.972278:0:215287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215287:1876834915900672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.972304:0:215287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.972319:0:215287:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.972337:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900672 00000100:00100000:2.0:1789892547.972341:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900672 00000100:00100000:2.0:1789892547.972361:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1789892547.972365:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215287:x1876834915900672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.972417:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215287:x1876834915900672:12345-0@lo:502:llog_process_th.0 Request processed in 51us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.972422:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1789892547.972450:0:215287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215287:1876834915900672:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892547.972475:0:215287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:1.0:1789892547.972585:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:1.0:1789892547.972611:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892547.972621:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.972633:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892547.972643:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892547.972645:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:1.0:1789892547.972648:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892547.972683:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.972691:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.972708:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.972725:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.972759:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.972789:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a02159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.972799:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900800 00000100:00100000:2.0:1789892547.972804:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900800 00000100:00100000:2.0:1789892547.972829:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:2.0:1789892547.972833:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915900800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.972839:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.972846:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021353b expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.972858:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.972865:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.972870:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe200, rc 0) 00000100:00100000:2.0:1789892547.972896:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915900800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.972913:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:1.0:1789892547.972945:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892547.972959:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.972968:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.973020:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.973049:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.973069:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a02159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.973085:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915900928 00000100:00100000:2.0:1789892547.973089:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915900928 00000100:00100000:2.0:1789892547.973109:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:2.0:1789892547.973113:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915900928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.973187:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915900928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.973192:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1789892547.973234:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915900928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.973262:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.973302:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.973323:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a02159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.973335:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901056 00000100:00100000:2.0:1789892547.973339:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901056 00000100:00100000:2.0:1789892547.973358:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:2.0:1789892547.973362:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915901056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.973420:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915901056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.973425:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1789892547.973471:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892547.974312:0:215288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789892547.974383:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789892547.974411:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892547.974418:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.974427:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892547.974436:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892547.974438:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 168 10000000:01000000:0.0:1789892547.974440:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892547.974457:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.974465:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.974473:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.974487:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.974566:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.974593:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.974627:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901184 00000100:00100000:2.0:1789892547.974633:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901184 00000100:00100000:2.0:1789892547.974661:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1789892547.974668:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915901184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.974676:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.974685:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213549 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.974703:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.974713:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.974727:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe600, rc 0) 00000100:00100000:2.0:1789892547.974764:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915901184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.974770:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1789892547.974798:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892547.974813:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.974824:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.974867:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.974897:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.974919:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.974941:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901312 00000100:00100000:2.0:1789892547.974947:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901312 00000100:00100000:2.0:1789892547.974972:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:2.0:1789892547.974979:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915901312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.975046:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915901312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.975055:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:0.0:1789892547.975067:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.975099:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.975152:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.975173:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.975185:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901440 00000100:00100000:2.0:1789892547.975190:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901440 00000100:00100000:2.0:1789892547.975215:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1789892547.975221:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915901440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.975288:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915901440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.975297:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1789892547.975310:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.975564:0:215289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215289:1876834915901568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.975594:0:215289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.975614:0:215289:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.975637:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901568 00000100:00100000:2.0:1789892547.975641:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901568 00000100:00100000:2.0:1789892547.975671:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1789892547.975678:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215289:x1876834915901568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.975772:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215289:x1876834915901568:12345-0@lo:502:llog_process_th.0 Request processed in 92us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.975780:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1789892547.975785:0:215289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215289:1876834915901568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.975840:0:215289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215289:1876834915901696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.975872:0:215289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.975893:0:215289:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.975902:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901696 00000100:00100000:2.0:1789892547.975906:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901696 00000100:00100000:2.0:1789892547.975926:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:2.0:1789892547.975930:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215289:x1876834915901696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.975995:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215289:x1876834915901696:12345-0@lo:502:llog_process_th.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.976002:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1789892547.976010:0:215289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215289:1876834915901696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892547.976031:0:215289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:1.0:1789892547.976080:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:1.0:1789892547.976097:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892547.976107:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.976114:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892547.976119:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892547.976120:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:1.0:1789892547.976122:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892547.976133:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.976151:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.976157:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.976167:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.976190:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.976205:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.976232:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901824 00000100:00100000:2.0:1789892547.976238:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901824 00000100:00100000:2.0:1789892547.976267:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:2.0:1789892547.976274:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915901824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.976280:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.976288:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213557 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.976299:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.976306:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.976310:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff600, rc 0) 00000100:00100000:2.0:1789892547.976337:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915901824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.976341:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:1.0:1789892547.976361:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892547.976372:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.976379:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.976408:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.976447:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.976464:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.976474:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915901952 00000100:00100000:2.0:1789892547.976478:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915901952 00000100:00100000:2.0:1789892547.976527:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1789892547.976535:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915901952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.976618:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915901952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.976627:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1789892547.976636:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915901952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.976659:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.976687:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.976711:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.976718:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902080 00000100:00100000:2.0:1789892547.976724:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902080 00000100:00100000:2.0:1789892547.976751:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:2.0:1789892547.976758:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915902080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.976833:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915902080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.976844:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:1.0:1789892547.976844:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892547.977464:0:215290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789892547.977537:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789892547.977559:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789892547.977567:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.977578:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892547.977587:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892547.977589:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 168 10000000:01000000:0.0:1789892547.977592:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892547.977607:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.977615:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.977624:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.977635:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.977656:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.977677:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.977689:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902208 00000100:00100000:2.0:1789892547.977693:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902208 00000100:00100000:2.0:1789892547.977715:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1789892547.977720:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915902208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.977725:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.977731:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213565 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.977742:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.977750:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.977755:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe400, rc 0) 00000100:00100000:2.0:1789892547.977781:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915902208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.977794:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1789892547.977810:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892547.977821:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.977837:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.977866:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.977888:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.977901:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.977914:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902336 00000100:00100000:2.0:1789892547.977918:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902336 00000100:00100000:2.0:1789892547.977938:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:2.0:1789892547.977942:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915902336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.977998:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915902336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.978002:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1789892547.978028:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.978047:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.978076:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.978090:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.978099:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902464 00000100:00100000:2.0:1789892547.978102:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902464 00000100:00100000:2.0:1789892547.978120:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1789892547.978124:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915902464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.978191:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915902464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.978198:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:0.0:1789892547.978209:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.978440:0:215291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215291:1876834915902592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.978476:0:215291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.978514:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902592 00000100:00100000:2.0:1789892547.978519:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902592 00000100:00100000:0.0:1789892547.978523:0:215291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068847259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.978545:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1789892547.978550:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215291:x1876834915902592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.978610:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215291:x1876834915902592:12345-0@lo:502:llog_process_th.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.978616:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1789892547.978632:0:215291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215291:1876834915902592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.978668:0:215291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215291:1876834915902720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.978704:0:215291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.978723:0:215291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068847259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.978737:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902720 00000100:00100000:2.0:1789892547.978741:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902720 00000100:00100000:2.0:1789892547.978759:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:2.0:1789892547.978763:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215291:x1876834915902720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.978821:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215291:x1876834915902720:12345-0@lo:502:llog_process_th.0 Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.978830:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1789892547.978840:0:215291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215291:1876834915902720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892547.978869:0:215291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:1.0:1789892547.978931:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:1.0:1789892547.978952:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892547.978958:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.978968:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892547.978977:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892547.978978:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 194 10000000:01000000:1.0:1789892547.978980:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892547.978992:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.978998:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.979003:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.979021:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.979043:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.979058:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.979076:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902848 00000100:00100000:2.0:1789892547.979079:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902848 00000100:00100000:2.0:1789892547.979099:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:2.0:1789892547.979103:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915902848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.979109:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.979115:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213573 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.979126:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.979133:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.979150:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffc00, rc 0) 00000100:00100000:2.0:1789892547.979179:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915902848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.979183:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:1.0:1789892547.979206:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892547.979216:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.979221:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.979249:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.979268:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.979282:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.979290:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915902976 00000100:00100000:2.0:1789892547.979294:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915902976 00000100:00100000:2.0:1789892547.979312:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1789892547.979316:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915902976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.979378:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915902976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892547.979385:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915902976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.979397:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:1.0:1789892547.979404:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.979447:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.979464:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.979468:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903104 00000100:00100000:2.0:1789892547.979473:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903104 00000100:00100000:2.0:1789892547.979514:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1789892547.979521:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915903104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.979577:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915903104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.979582:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:1.0:1789892547.979592:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.979794:0:215292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215292:1876834915903232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892547.979823:0:215292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.979841:0:215292:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a0215a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.979866:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903232 00000100:00100000:2.0:1789892547.979872:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903232 00000100:00100000:2.0:1789892547.979893:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1789892547.979898:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215292:x1876834915903232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.979965:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215292:x1876834915903232:12345-0@lo:502:llog_process_th.0 Request processed in 67us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.979971:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:1.0:1789892547.979978:0:215292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215292:1876834915903232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892547.980001:0:215292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892547.980013:0:215292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892547.980015:0:215292:0:(obd_config.c:1561:class_process_config()) marker 184 (0x1) lustre-MDT0001-m new lustre.qpool2 00000020:00000080:1.0:1789892547.980020:0:215292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1789892547.980067:0:215292:0:(lod_pool.c:475:lod_pool_new()) qpool2 is pool #2 00000100:00100000:1.0:1789892547.980081:0:215292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215292:1876834915903360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892547.980112:0:215292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.980131:0:215292:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fac840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.980158:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903360 00000100:00100000:2.0:1789892547.980162:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903360 00000100:00100000:2.0:1789892547.980181:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:2.0:1789892547.980184:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215292:x1876834915903360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.980236:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215292:x1876834915903360:12345-0@lo:502:llog_process_th.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.980241:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:1.0:1789892547.980263:0:215292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215292:1876834915903360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892547.980287:0:215292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892547.980292:0:215292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892547.980294:0:215292:0:(obd_config.c:1561:class_process_config()) marker 184 (0x2) lustre-MDT0001-m new lustre.qpool2 00000040:00080000:1.0:1789892547.980298:0:215292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 197 count 193 00000020:01000000:0.0:1789892547.980352:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 194-196 (rc=0) 10000000:01000000:0.0:1789892547.980371:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892547.980381:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.980389:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892547.980394:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892547.980395:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 168 10000000:01000000:0.0:1789892547.980397:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892547.980409:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.980417:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.980426:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.980440:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.980470:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892547.980509:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903488 00000100:00100000:2.0:1789892547.980512:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903488 00000100:00100000:2.0:1789892547.980538:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1789892547.980544:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915903488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.980554:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789892547.980556:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068847259c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789892547.980562:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213581 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.980574:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.980579:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.980584:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffec00, rc 0) 00000100:00100000:2.0:1789892547.980607:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915903488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.980612:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1789892547.980631:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892547.980642:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.980648:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.980677:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.980704:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.980718:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068847259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.980734:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903616 00000100:00100000:2.0:1789892547.980738:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903616 00000100:00100000:2.0:1789892547.980760:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:2.0:1789892547.980764:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915903616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.980817:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915903616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.980825:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1789892547.980838:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.980860:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.980887:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.980901:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068847259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.980912:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903744 00000100:00100000:2.0:1789892547.980916:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903744 00000100:00100000:2.0:1789892547.980935:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1789892547.980939:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915903744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.980993:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915903744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892547.981005:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915903744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.981007:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:0.0:1789892547.981211:0:215293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215293:1876834915903872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.981238:0:215293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.981253:0:215293:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.981274:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915903872 00000100:00100000:2.0:1789892547.981278:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915903872 00000100:00100000:2.0:1789892547.981296:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:2.0:1789892547.981302:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215293:x1876834915903872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.981369:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215293:x1876834915903872:12345-0@lo:502:llog_process_th.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.981378:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1789892547.981392:0:215293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215293:1876834915903872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.981431:0:215293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215293:1876834915904000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892547.981467:0:215293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.981487:0:215293:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.981518:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904000 00000100:00100000:2.0:1789892547.981522:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904000 00000100:00100000:2.0:1789892547.981543:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1789892547.981549:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215293:x1876834915904000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.981599:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215293:x1876834915904000:12345-0@lo:502:llog_process_th.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.981605:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:0.0:1789892547.981622:0:215293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215293:1876834915904000:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892547.981646:0:215293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:1.0:1789892547.981705:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:1.0:1789892547.981728:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892547.981734:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.981744:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892547.981752:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892547.981754:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 194 10000000:01000000:1.0:1789892547.981757:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892547.981773:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.981781:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.981789:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.981810:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.981840:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.981868:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fac840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.981880:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904128 00000100:00100000:2.0:1789892547.981884:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904128 00000100:00100000:2.0:1789892547.981903:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1789892547.981907:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915904128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.981912:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.981918:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021358f expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.981929:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.981935:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.981945:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe800, rc 0) 00000100:00100000:2.0:1789892547.981968:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915904128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.981974:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:1.0:1789892547.981996:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892547.982011:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892547.982020:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892547.982078:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.982107:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.982124:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fac840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.982148:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904256 00000100:00100000:2.0:1789892547.982152:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904256 00000100:00100000:2.0:1789892547.982170:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:2.0:1789892547.982174:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915904256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.982221:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915904256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.982227:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:1.0:1789892547.982246:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.982275:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.982315:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.982333:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884fac840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.982336:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904384 00000100:00100000:2.0:1789892547.982340:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904384 00000100:00100000:2.0:1789892547.982365:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:2.0:1789892547.982374:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915904384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.982432:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915904384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.982438:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:1.0:1789892547.982457:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892547.982643:0:215294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215294:1876834915904512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892547.982682:0:215294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.982707:0:215294:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884faccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.982719:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904512 00000100:00100000:2.0:1789892547.982723:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904512 00000100:00100000:2.0:1789892547.982741:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1789892547.982745:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215294:x1876834915904512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.982807:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215294:x1876834915904512:12345-0@lo:502:llog_process_th.0 Request processed in 61us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.982812:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:1.0:1789892547.982830:0:215294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215294:1876834915904512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892547.982856:0:215294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892547.982868:0:215294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892547.982870:0:215294:0:(obd_config.c:1561:class_process_config()) marker 183 (0x1) lustre-MDT0000-m new lustre.qpool2 00000020:00000080:1.0:1789892547.982878:0:215294:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1789892547.982912:0:215294:0:(lod_pool.c:475:lod_pool_new()) qpool2 is pool #2 00080000:10000000:1.0:1789892547.983557:0:215294:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x58:0x0] (8/32) registered 00080000:10000000:1.0:1789892547.984886:0:215294:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x59:0x0] (8/32) registered 00080000:10000000:1.0:1789892547.985659:0:215294:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5a:0x0] (8/32) registered 00000100:00100000:1.0:1789892547.986239:0:215294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215294:1876834915904640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892547.986271:0:215294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892547.986291:0:215294:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.986321:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904640 00000100:00100000:2.0:1789892547.986327:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904640 00000100:00100000:2.0:1789892547.986358:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1789892547.986366:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215294:x1876834915904640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892547.986447:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215294:x1876834915904640:12345-0@lo:502:llog_process_th.0 Request processed in 82us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.986455:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:1.0:1789892547.986464:0:215294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215294:1876834915904640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892547.986486:0:215294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892547.986505:0:215294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892547.986507:0:215294:0:(obd_config.c:1561:class_process_config()) marker 183 (0x2) lustre-MDT0000-m new lustre.qpool2 00000040:00080000:1.0:1789892547.986511:0:215294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 197 count 193 00000020:01000000:0.0:1789892547.986550:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 194-196 (rc=0) 10000000:01000000:0.0:1789892547.986575:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789892547.986581:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.986589:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892547.986604:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789892547.986606:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:0.0:1789892547.986608:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789892547.986621:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.986627:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.986633:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.986642:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.986666:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.986687:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.986711:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904768 00000100:00100000:2.0:1789892547.986717:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904768 00000100:00100000:2.0:1789892547.986742:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:2.0:1789892547.986749:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915904768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892547.986757:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892547.986767:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021359d expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.986784:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.986794:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892547.986802:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffa00, rc 0) 00000100:00100000:2.0:1789892547.986838:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915904768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892547.986846:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1789892547.986860:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892547.986872:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.986879:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892547.986910:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892547.986930:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892547.986943:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892547.986959:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915904896 00000100:00100000:2.0:1789892547.986965:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915904896 00000100:00100000:2.0:1789892547.986993:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:2.0:1789892547.987001:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915904896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892547.987066:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915904896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892547.987074:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:0.0:1789892547.987075:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915904896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789892547.987107:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789892547.987112:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892547.987117:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892548.386647:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892549.410640:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892549.455394:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892549.455485:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852544 00000100:00100000:2.0:1789892549.455539:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852544 00000100:00100000:2.0:1789892549.455593:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2155 00000100:00100000:2.0:1789892549.455602:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925852544:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892549.455619:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892549.455640:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a629 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892549.455674:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892549.455688:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892549.455696:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffe00, rc 0) 00000100:00100000:2.0:1789892549.455748:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925852544:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 147us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892549.455754:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2155 00000100:00100000:3.0:1789892549.456596:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892549.456654:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852672 00000100:00100000:0.0:1789892549.456660:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852672 00000100:00100000:0.0:1789892549.456698:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2156 00000100:00100000:0.0:1789892549.456708:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925852672:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892549.456839:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925852672:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 133us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892549.456846:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2156 00000100:00100000:3.0:1789892549.457570:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892549.457607:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852800 00000100:00100000:2.0:1789892549.457613:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852800 00000100:00100000:2.0:1789892549.457649:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2157 00000100:00100000:2.0:1789892549.457660:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925852800:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892549.457756:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925852800:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 99us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892549.457769:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2157 00000100:00100000:3.0:1789892549.458624:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892549.458664:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925852928 00000100:00100000:0.0:1789892549.458669:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925852928 00000100:00100000:0.0:1789892549.458706:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2158 00000100:00100000:0.0:1789892549.458715:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213958:x1876834925852928:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892549.458801:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213958:x1876834925852928:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 88us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892549.458808:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2158 00000100:00100000:3.0:1789892549.459440:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892549.459483:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853056 00000100:00100000:2.0:1789892549.459504:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853056 00000100:00100000:2.0:1789892549.459530:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2159 00000100:00100000:2.0:1789892549.459539:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213958:x1876834925853056:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892549.459598:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213958:x1876834925853056:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892549.459604:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2159 00000100:00100000:3.0:1789892549.460397:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892549.460436:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853184 00000100:00100000:0.0:1789892549.460441:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853184 00000100:00100000:0.0:1789892549.460470:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2160 00000100:00100000:0.0:1789892549.460478:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925853184:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892549.460487:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892549.460530:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a630 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892549.460548:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892549.460559:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892549.460568:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892549.460599:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925853184:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 121us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892549.460605:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2160 00000100:00100000:3.0:1789892549.461201:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892549.461236:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853312 00000100:00100000:2.0:1789892549.461241:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853312 00000100:00100000:2.0:1789892549.461264:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2161 00000100:00100000:2.0:1789892549.461270:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925853312:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892549.461313:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925853312:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 42us (112us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892549.461319:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2161 00000100:00100000:3.0:1789892549.519250:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892549.519279:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892549.519322:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853440 00000100:00100000:2.0:1789892549.519331:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853568 00000100:00100000:1.0:1789892549.519332:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853440 00000100:00100000:2.0:1789892549.519339:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853568 00000100:00080000:3.0:1789892549.519391:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892549.519396:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892549.519411:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 473 00000100:00100000:1.0:1789892549.519420:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 474 00000100:00100000:2.0:1789892549.519422:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925853568:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892549.519434:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:2400:x1876834925853440:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892549.519517:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:2400:x1876834925853440:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892549.519529:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 474 00000100:00100000:2.0:1789892549.519530:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925853568:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892549.519539:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 473 00000020:00000080:2.0:1789892550.305645:0:215392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffde0011770 20000000:00000080:2.0:1789892550.305659:0:215392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff906998c74000 uarg=0000000000000000 00000040:00100000:2.0:1789892550.306159:0:215392:0:(llog.c:1072:llog_reverse_process()) index 170 : idx 137 20000000:01000000:2.0:1789892550.306165:0:215392:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 169 cmd:0xce020 lustre.qpool2 00000040:00080000:2.0:1789892550.306240:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].171, 224 off39432 20000000:01000000:2.0:1789892550.306255:0:215392:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892550.306265:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].172, 128 off39560 00000040:00080000:2.0:1789892550.306277:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].173, 224 off39784 00000040:00080000:2.0:1789892550.306316:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].197, 224 off44232 20000000:01000000:2.0:1789892550.306322:0:215392:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892550.306331:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].198, 136 off44368 00000040:00080000:2.0:1789892550.306340:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].199, 224 off44592 00000040:00080000:2.0:1789892550.306377:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].197, 224 off44232 20000000:01000000:2.0:1789892550.306383:0:215392:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892550.306391:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].198, 136 off44368 00000040:00080000:2.0:1789892550.306401:0:215392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].199, 224 off44592 10000000:01000000:2.0:1789892550.306408:0:215392:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892550.306424:0:215392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306439:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306445:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306449:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306454:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306458:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306468:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306472:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306476:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306481:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306487:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306508:0:215392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306515:0:215392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306547:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306557:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 9 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.306569:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905024:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892550.306649:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306661:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 9 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.306669:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882605500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905152:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892550.306694:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306700:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 23 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.306706:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905280:0@lo:104: 00000100:00100000:2.0:1789892550.306735:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892550.306764:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.306772:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 23 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.306776:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915905280 00000100:00100000:2.0:1789892550.306781:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905408:0@lo:104: 00000100:00100000:0.0:1789892550.306783:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915905280 00000100:00100000:2.0:1789892550.306799:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892550.306823:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.306829:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915905408 00010000:00010000:2.0:1789892550.306832:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 23 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.306834:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915905408 00000100:00100000:2.0:1789892550.306845:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905536:0@lo:104: 00000100:00100000:1.0:1789892550.306856:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789892550.306866:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789892550.306870:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892550.306873:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882605180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215392:x1876834915905280:12345-0@lo:104: 00000100:00100000:0.0:1789892550.306882:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215392:x1876834915905408:12345-0@lo:104: 00010000:00010000:1.0:1789892550.306890:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.306892:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.306908:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915905536 00000100:00100000:2.0:1789892550.306913:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915905536 00000100:00100000:2.0:1789892550.306949:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1789892550.306957:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915905536:12345-0@lo:104: 00010000:00010000:2.0:1789892550.306965:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.306967:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892550.306977:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915905408:12345-0@lo:104: Request processed in 100us (176us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892550.306978:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892550.306984:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789892550.306993:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882605180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915905280:12345-0@lo:104: Request processed in 126us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892550.307001:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00010000:00010000:0.0:1789892550.307015:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892550.307025:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892550.307029:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307031:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789892550.307038:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215392:x1876834915905536:12345-0@lo:104: Request processed in 77us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892550.307040:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.307061:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00010000:00010000:1.0:1789892550.307062:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837c00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892550.307065:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892550.307071:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.307072:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892550.307072:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307105:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307109:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892550.307110:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307118:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.307120:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 23 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892550.307127:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892550.307136:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307143:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836e00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892550.307151:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892550.307151:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789892550.307153:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892550.307158:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905664:0@lo:104: 00010000:00010000:2.0:1789892550.307176:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892550.307182:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307186:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892550.307187:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892550.307192:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307204:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892550.307207:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892550.307212:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307218:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892550.307227:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.307231:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307233:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307237:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd0021359d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135a4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.307254:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800600/0x5c4f93dd0021358f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213596 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307257:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd00213581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213588 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307264:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.307269:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892550.307275:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.307276:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892550.307278:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892550.307279:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892550.307284:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892550.307285:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892550.307289:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892550.307301:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915905920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892550.307306:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915905792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892550.307313:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892550.307315:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915906048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892550.307344:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892550.307357:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915905664 00000100:00100000:3.0:1789892550.307369:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915905664 00000100:00100000:1.0:1789892550.307373:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915905920 00000100:00100000:2.0:1789892550.307374:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892550.307380:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915905920 00010000:00010000:1.0:1789892550.307404:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 24 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.307411:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892550.307427:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00010000:00010000:2.0:1789892550.307440:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.307440:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1789892550.307447:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215392:x1876834915905664:12345-0@lo:104: 00000100:00100000:1.0:1789892550.307453:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915905920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892550.307455:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 24 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.307460:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906048 00010000:00010000:3.0:1789892550.307464:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307470:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892550.307474:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906176:0@lo:104: 00000100:00100000:0.0:1789892550.307475:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906048 00010000:00010000:1.0:1789892550.307479:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 24 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307518:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 25 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.307532:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 25 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307536:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892550.307552:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892550.307566:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892550.307566:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915905792 00000100:00100000:0.0:1789892550.307573:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915905792 00000100:00100000:3.0:1789892550.307578:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215392:x1876834915905664:12345-0@lo:104: Request processed in 136us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892550.307589:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00010000:00010000:0.0:1789892550.307595:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 26 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.307602:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915905920:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (257us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892550.307606:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 26 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.307618:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:2.0:1789892550.307628:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 26 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.307632:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1789892550.307640:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1789892550.307646:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906304:0@lo:104: 00000100:00100000:0.0:1789892550.307646:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915906048:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892550.307653:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915905792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892550.307661:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892550.307667:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892550.307667:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 25 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.307677:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 25 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.307682:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 25 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.307693:0:193633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789892550.307703:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 25 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307711:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 25 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.307722:0:193633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892550.307734:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 25 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.307735:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906432:0@lo:104: 00000100:00100000:3.0:1789892550.307742:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906176 00000100:00100000:3.0:1789892550.307749:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906176 00010000:00010000:0.0:1789892550.307760:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892550.307761:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892550.307770:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892550.307781:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906304 00000100:00100000:3.0:1789892550.307786:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906304 00010000:00010000:2.0:1789892550.307799:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 25 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307808:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 25 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.307810:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906432 00000100:00100000:3.0:1789892550.307816:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906432 00000100:00100000:0.0:1789892550.307817:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915906048:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892550.307820:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915905792:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892550.307825:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906560:0@lo:104: 00000100:00100000:0.0:1789892550.307835:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789892550.307836:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789892550.307842:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1789892550.307850:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915906176:12345-0@lo:104: 00000100:00100000:2.0:1789892550.307860:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892550.307868:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906560 00000100:00100000:0.0:1789892550.307873:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906560 00010000:00010000:2.0:1789892550.307887:0:215392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.307896:0:215392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 23 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.307901:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1789892550.307910:0:215392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906688:0@lo:104: 00000100:00100000:0.0:1789892550.307916:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+6:215392:x1876834915906304:12345-0@lo:104: 00010000:00010000:3.0:1789892550.307919:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.307922:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915905920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892550.307924:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.307938:0:215392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892550.307958:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915905792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892550.307960:0:215392:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699024f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892550.307978:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906688 00000100:00100000:1.0:1789892550.307983:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906688 00010000:00010000:2.0:1789892550.307987:0:215392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021359d expref: 23 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308004:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905280:0@lo:104: 00010000:00010000:3.0:1789892550.308007:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892550.308009:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00010000:00010000:0.0:1789892550.308012:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892550.308024:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+7:215392:x1876834915906432:12345-0@lo:104: 00000100:00100000:3.0:1789892550.308025:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af806450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+7:215392:x1876834915906176:12345-0@lo:104: Request processed in 175us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892550.308031:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+7:215392:x1876834915906304:12345-0@lo:104: Request processed in 117us (309us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892550.308033:0:215392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe800/0x5c4f93dd00213596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021358f expref: 22 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308036:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.308048:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789892550.308059:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1789892550.308069:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905408:0@lo:104: 00000100:00100000:0.0:1789892550.308087:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00010000:00010000:2.0:1789892550.308106:0:215392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd00213588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213581 expref: 21 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.308114:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915906560:12345-0@lo:104: 00010000:00010000:1.0:1789892550.308119:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789892550.308128:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.308133:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789892550.308133:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905536:0@lo:104: 00000100:00100000:1.0:1789892550.308134:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915906432:12345-0@lo:104: Request processed in 109us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892550.308148:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1789892550.308153:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215392:x1876834915906688:12345-0@lo:104: 00000100:00100000:2.0:1789892550.308159:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905664:0@lo:104: 00010000:00010000:1.0:1789892550.308167:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892550.308172:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308175:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308176:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906176:0@lo:104: 00010000:00010000:0.0:1789892550.308183:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789892550.308187:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892550.308193:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.308195:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215392:x1876834915906560:12345-0@lo:104: Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892550.308196:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906304:0@lo:104: 00000100:00100000:2.0:1789892550.308213:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906432:0@lo:104: 00010000:00010000:1.0:1789892550.308214:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.308215:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 10000000:00010000:1.0:1789892550.308227:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308232:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906560:0@lo:104: 10000000:01000000:1.0:1789892550.308243:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892550.308246:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789892550.308251:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915906688:0@lo:104: 00000100:00100000:3.0:1789892550.308257:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215392:x1876834915906688:12345-0@lo:104: Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892550.308267:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00010000:00010000:1.0:1789892550.308268:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308275:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892550.308277:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915906048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892550.308290:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308297:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd00213573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021357a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308299:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789892550.308300:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892550.308307:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892550.308307:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308310:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308311:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308326:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801c00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892550.308332:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837e00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892550.308333:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308335:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892550.308337:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892550.308345:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308355:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308357:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:1.0:1789892550.308362:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892550.308377:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892550.308378:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308384:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 10000000:01000000:1.0:1789892550.308400:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789892550.308400:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892550.308405:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853696 00000100:00100000:2.0:1789892550.308410:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853696 00010000:00010000:1.0:1789892550.308412:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308418:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892550.308421:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.308428:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 10 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308433:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308435:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892550.308451:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308457:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd00213549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213550 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308461:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853824 00010000:00010000:0.0:1789892550.308463:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892550.308467:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853824 10000000:01000000:3.0:1789892550.308479:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892550.308481:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 11 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308482:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892550.308486:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308550:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021355e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308562:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892550.308567:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308594:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 509 00000100:00100000:2.0:1789892550.308605:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925853696:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892550.308615:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892550.308620:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 11 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.308641:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 11 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.308650:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892550.308675:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925853696:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 74us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892550.308681:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 509 00000100:00100000:2.0:1789892550.308695:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 510 00000100:00100000:2.0:1789892550.308701:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925853824:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892550.308707:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892550.308710:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 10 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.308717:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 10 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.308726:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892550.308738:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925853824:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892550.308742:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 510 00010000:00010000:2.0:1789892550.308758:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892550.308779:0:215392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837600/0x5c4f93dd002135b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a630 expref: 9 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.308789:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905024:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892550.308791:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892550.308796:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.308800:0:215392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a629 expref: 8 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308805:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308806:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892550.308827:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308829:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308831:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892550.308838:0:215392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882605500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215392:1876834915905152:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892550.308846:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892550.308848:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892550.308852:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892550.308858:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308864:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837000/0x5c4f93dd00213565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021356c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308867:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308869:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892550.308876:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308890:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892550.308893:0:215392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892550.308895:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892550.308899:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308905:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892550.308911:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.308916:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.308917:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.308936:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892550.308939:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd0021352d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213534 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.308944:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308950:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.308951:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd0021353b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213542 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.308955:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892550.308959:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892550.308965:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915906816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892550.308976:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915907200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892550.308977:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.308982:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892550.308985:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892550.309014:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892550.309039:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915906944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892550.309040:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906816 00000100:00100000:1.0:1789892550.309046:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906816 00010000:00010000:1.0:1789892550.309065:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 21 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309070:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915907328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892550.309078:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892550.309089:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907200 00000100:00100000:1.0:1789892550.309108:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907200 00010000:00010000:1.0:1789892550.309121:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 22 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.309128:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789892550.309129:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892550.309144:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915907072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892550.309155:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907328 00000100:00100000:1.0:1789892550.309158:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907328 00010000:00010000:1.0:1789892550.309172:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 23 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309185:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1789892550.309192:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1789892550.309199:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915906816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892550.309205:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3620:x1876834915907200:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892550.309205:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892550.309212:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892550.309217:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892550.309219:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 23 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309224:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 23 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.309226:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907072 00010000:00010000:2.0:1789892550.309235:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 23 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.309236:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907072 00010000:00010000:1.0:1789892550.309249:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 24 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.309257:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00010000:00010000:3.0:1789892550.309260:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 24 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892550.309264:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021357a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213573 expref: 24 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309268:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe400/0x5c4f93dd0021356c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213565 expref: 24 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.309274:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915907328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892550.309292:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892550.309295:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892550.309302:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00010000:00010000:1.0:1789892550.309305:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892550.309308:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 22 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892550.309317:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915907072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892550.309326:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 22 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309327:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915906816:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (315us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892550.309331:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892550.309342:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 22 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309346:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1789892550.309347:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915907200:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (275us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892550.309355:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff000/0x5c4f93dd00213534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021352d expref: 22 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.309365:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00010000:00010000:3.0:1789892550.309375:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 21 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309379:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915906816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892550.309387:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892550.309394:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff600/0x5c4f93dd0021355e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213557 expref: 19 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.309409:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915907200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892550.309410:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892550.309437:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892550.309442:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892550.309446:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915907328:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892550.309457:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1789892550.309464:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915907456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892550.309472:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3620:x1876834915907072:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892550.309479:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1789892550.309513:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892550.309514:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915906944 00000100:00100000:0.0:1789892550.309521:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915906944 00000100:00100000:3.0:1789892550.309529:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907456 00000100:00100000:3.0:1789892550.309534:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907456 00010000:00010000:0.0:1789892550.309544:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 18 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.309557:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 18 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309575:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915907328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892550.309583:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1789892550.309590:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1789892550.309597:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915906944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892550.309603:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915907456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892550.309612:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892550.309613:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892550.309619:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915907072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892550.309625:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 18 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.309626:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 18 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309646:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 18 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.309658:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 18 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309675:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe200/0x5c4f93dd00213542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021353b expref: 18 pid: 189432 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.309680:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213549 expref: 18 pid: 189434 timeout: 3475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309693:0:189426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309704:0:189426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892550.309712:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892550.309716:0:189426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309723:0:189426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309733:0:189426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309738:0:189426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309742:0:189426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff200 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:1.0:1789892550.309745:0:189426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892550.309750:0:189426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892550.309758:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3622:x1876834915906944:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892550.309767:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00010000:00010000:1.0:1789892550.309773:0:189426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892550.309780:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915906944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892550.309787:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892550.309800:0:215392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.309807:0:215392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892550.309812:0:215392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff200/0x5c4f93dd002135b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892550.309828:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915907456:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892550.309836:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1789892550.309839:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915907456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892550.434696:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892551.458750:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892551.458813:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789892551.458843:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915907584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892551.458957:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.459054:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907584 00000100:00100000:1.0:1789892551.459101:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907584 00000100:00100000:1.0:1789892551.459206:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789892551.459239:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915907584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892551.459292:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892551.459392:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915907584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892551.459407:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789892551.459557:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915907584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892551.631858:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892551.631956:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925853952 00000100:00100000:0.0:1789892551.631972:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925853952 00000100:00100000:0.0:1789892551.632051:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2162 00000100:00100000:0.0:1789892551.632089:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925853952:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892551.632123:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892551.632148:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a637 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.632186:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.632224:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.632237:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892551.632314:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925853952:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 251us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892551.632324:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2162 00000100:00100000:3.0:1789892551.633821:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892551.633928:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854080 00000100:00100000:2.0:1789892551.633941:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854080 00000100:00100000:2.0:1789892551.634019:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2163 00000100:00100000:2.0:1789892551.634038:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925854080:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.634268:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925854080:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 233us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.634284:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2163 00000100:00100000:2.0:1789892551.635642:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892551.635771:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854208 00000100:00100000:0.0:1789892551.635782:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854208 00000100:00100000:0.0:1789892551.635835:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2164 00000100:00100000:0.0:1789892551.635846:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925854208:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.635993:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925854208:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892551.636004:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2164 00000100:00100000:3.0:1789892551.638016:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892551.638127:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854336 00000100:00100000:2.0:1789892551.638139:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854336 00000100:00100000:2.0:1789892551.638190:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2165 00000100:00100000:2.0:1789892551.638205:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213991:x1876834925854336:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892551.638354:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213991:x1876834925854336:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 151us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.638365:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2165 00000100:00100000:3.0:1789892551.639645:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892551.639729:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854464 00000100:00100000:0.0:1789892551.639739:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854464 00000100:00100000:0.0:1789892551.639816:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2166 00000100:00100000:0.0:1789892551.639827:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213991:x1876834925854464:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892551.639952:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:213991:x1876834925854464:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892551.639964:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2166 00000100:00100000:3.0:1789892551.641647:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892551.641733:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854592 00000100:00100000:2.0:1789892551.641744:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854592 00000100:00100000:2.0:1789892551.641817:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2167 00000100:00100000:2.0:1789892551.641829:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925854592:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.641844:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.641869:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a63e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.641896:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.641917:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.641942:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffe00, rc 0) 00000100:00100000:2.0:1789892551.642008:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925854592:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.642019:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2167 00000100:00100000:3.0:1789892551.643298:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892551.643377:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854720 00000100:00100000:0.0:1789892551.643386:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854720 00000100:00100000:0.0:1789892551.643433:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2168 00000100:00100000:0.0:1789892551.643443:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925854720:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.643574:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925854720:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 129us (277us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892551.643585:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2168 10000000:01000000:0.0:1789892551.778665:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892551.778677:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 171 10000000:01000000:0.0:1789892551.778685:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892551.778755:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.778776:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.778795:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.778834:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915907712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.778937:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.779004:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.779096:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907712 00000100:00100000:2.0:1789892551.779120:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907712 00000100:00100000:2.0:1789892551.779197:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:2.0:1789892551.779208:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915907712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.779226:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.779244:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002135ce expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.779303:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.779316:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.779347:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffec00, rc 0) 00000100:00100000:2.0:1789892551.779411:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915907712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.779420:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:0.0:1789892551.779512:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915907712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892551.779535:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.779548:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.779622:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915907840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.779661:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.779718:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.779767:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907840 00000100:00100000:2.0:1789892551.779776:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907840 00000100:00100000:2.0:1789892551.779820:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1789892551.779829:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915907840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.779976:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915907840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.779985:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:0.0:1789892551.780038:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915907840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.780102:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915907968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.780164:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.780189:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.780225:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915907968 00000100:00100000:2.0:1789892551.780232:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915907968 00000100:00100000:2.0:1789892551.780265:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:2.0:1789892551.780272:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915907968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.780387:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915907968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.780396:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:0.0:1789892551.780438:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915907968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.780934:0:215393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215393:1876834915908096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.780995:0:215393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.781037:0:215393:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.781140:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908096 00000100:00100000:2.0:1789892551.781148:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908096 00000100:00100000:2.0:1789892551.781206:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:2.0:1789892551.781214:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215393:x1876834915908096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.781363:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215393:x1876834915908096:12345-0@lo:502:llog_process_th.0 Request processed in 143us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.781375:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1789892551.781440:0:215393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215393:1876834915908096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.781501:0:215393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215393:1876834915908224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.781573:0:215393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.781616:0:215393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.781633:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908224 00000100:00100000:2.0:1789892551.781639:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908224 00000100:00100000:2.0:1789892551.781673:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:2.0:1789892551.781680:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215393:x1876834915908224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.781761:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215393:x1876834915908224:12345-0@lo:502:llog_process_th.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.781769:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1789892551.781807:0:215393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215393:1876834915908224:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892551.781839:0:215393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:1.0:1789892551.781965:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:1.0:1789892551.782016:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892551.782027:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.782041:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892551.782053:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892551.782055:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:1.0:1789892551.782059:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892551.782114:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.782126:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.782139:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.782161:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.782211:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.782242:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.782265:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908352 00000100:00100000:2.0:1789892551.782272:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908352 00000100:00100000:2.0:1789892551.782299:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1789892551.782310:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915908352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.782319:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.782328:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002135dc expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.782347:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.782357:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.782364:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe800, rc 0) 00000100:00100000:2.0:1789892551.782402:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915908352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.782408:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:1.0:1789892551.782471:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892551.782539:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.782554:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.782641:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.782703:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.782751:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.782770:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908480 00000100:00100000:2.0:1789892551.782777:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908480 00000100:00100000:2.0:1789892551.782817:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:2.0:1789892551.782824:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915908480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.782933:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915908480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.782941:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:1.0:1789892551.783012:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.783085:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.783257:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.783289:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.783321:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908608 00000100:00100000:2.0:1789892551.783329:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908608 00000100:00100000:2.0:1789892551.783363:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:2.0:1789892551.783369:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915908608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.783469:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915908608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.783477:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:1.0:1789892551.783570:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892551.784687:0:215394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789892551.784775:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789892551.784802:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892551.784810:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.784822:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892551.784831:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892551.784833:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 171 10000000:01000000:0.0:1789892551.784862:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892551.784883:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.784892:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.784902:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.784919:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.784955:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.784989:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.785031:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908736 00000100:00100000:2.0:1789892551.785041:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908736 00000100:00100000:2.0:1789892551.785135:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1789892551.785146:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915908736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.785157:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.785170:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002135ea expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.785193:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.785207:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.785218:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffa00, rc 0) 00000100:00100000:2.0:1789892551.785261:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915908736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.785278:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:0.0:1789892551.785304:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892551.785320:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.785330:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.785373:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.785401:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.785423:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.785481:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908864 00000100:00100000:2.0:1789892551.785524:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908864 00000100:00100000:2.0:1789892551.785572:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:2.0:1789892551.785583:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915908864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.785715:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915908864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.785730:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1789892551.785745:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.785780:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.785821:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.785849:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.785889:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915908992 00000100:00100000:2.0:1789892551.785898:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915908992 00000100:00100000:2.0:1789892551.785948:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1789892551.785961:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915908992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.786108:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915908992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.786123:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1789892551.786144:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915908992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.786456:0:215395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215395:1876834915909120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.786534:0:215395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.786585:0:215395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.786621:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909120 00000100:00100000:2.0:1789892551.786630:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909120 00000100:00100000:2.0:1789892551.786679:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1789892551.786692:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215395:x1876834915909120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.786825:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215395:x1876834915909120:12345-0@lo:502:llog_process_th.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.786838:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:0.0:1789892551.786876:0:215395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215395:1876834915909120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.786941:0:215395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215395:1876834915909248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.786997:0:215395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.787027:0:215395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.787085:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909248 00000100:00100000:2.0:1789892551.787094:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909248 00000100:00100000:2.0:1789892551.787142:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1789892551.787154:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215395:x1876834915909248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.787293:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215395:x1876834915909248:12345-0@lo:502:llog_process_th.0 Request processed in 139us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.787308:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:0.0:1789892551.787327:0:215395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215395:1876834915909248:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892551.787367:0:215395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:1.0:1789892551.787470:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:1.0:1789892551.787530:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892551.787539:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.787551:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892551.787560:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892551.787562:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:1.0:1789892551.787565:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892551.787596:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.787603:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.787625:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.787647:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.787693:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.787731:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.787764:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909376 00000100:00100000:2.0:1789892551.787773:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909376 00000100:00100000:2.0:1789892551.787819:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:2.0:1789892551.787830:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915909376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.787843:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.787857:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002135f8 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.787882:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.787897:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.787909:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892551.787971:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915909376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.787982:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:1.0:1789892551.788011:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892551.788028:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.788037:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.788107:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.788136:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.788156:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.788203:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909504 00000100:00100000:2.0:1789892551.788212:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909504 00000100:00100000:2.0:1789892551.788267:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1789892551.788279:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915909504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.788412:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915909504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.788441:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:1.0:1789892551.788446:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.788515:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.788569:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.788596:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.788625:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909632 00000100:00100000:2.0:1789892551.788634:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909632 00000100:00100000:2.0:1789892551.788680:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:2.0:1789892551.788692:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915909632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.788813:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915909632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.788826:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:1.0:1789892551.788857:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892551.789954:0:215396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789892551.790028:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789892551.790055:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789892551.790077:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.790089:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892551.790097:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892551.790099:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 171 10000000:01000000:0.0:1789892551.790102:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892551.790127:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.790134:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.790155:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.790170:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.790202:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.790232:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.790259:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909760 00000100:00100000:2.0:1789892551.790266:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909760 00000100:00100000:2.0:1789892551.790299:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:2.0:1789892551.790306:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915909760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.790315:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.790325:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213606 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.790343:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.790353:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.790360:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffee00, rc 0) 00000100:00100000:2.0:1789892551.790403:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915909760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.790410:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:0.0:1789892551.790450:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892551.790470:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.790484:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.790566:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.790601:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.790630:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.790654:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915909888 00000100:00100000:2.0:1789892551.790667:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915909888 00000100:00100000:2.0:1789892551.790703:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:2.0:1789892551.790709:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915909888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.790804:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915909888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.790811:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:0.0:1789892551.790843:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915909888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.790883:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.790951:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.790976:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.790990:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910016 00000100:00100000:2.0:1789892551.790998:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910016 00000100:00100000:2.0:1789892551.791042:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:2.0:1789892551.791086:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915910016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.791220:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915910016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.791234:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1789892551.791254:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.791699:0:215397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215397:1876834915910144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.791750:0:215397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.791804:0:215397:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.791826:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910144 00000100:00100000:2.0:1789892551.791834:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910144 00000100:00100000:2.0:1789892551.791873:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1789892551.791882:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215397:x1876834915910144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.792013:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215397:x1876834915910144:12345-0@lo:502:llog_process_th.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.792027:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:0.0:1789892551.792049:0:215397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215397:1876834915910144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.792130:0:215397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215397:1876834915910272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.792182:0:215397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.792201:0:215397:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.792216:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910272 00000100:00100000:2.0:1789892551.792222:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910272 00000100:00100000:2.0:1789892551.792254:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:2.0:1789892551.792260:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215397:x1876834915910272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.792348:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215397:x1876834915910272:12345-0@lo:502:llog_process_th.0 Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.792365:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:0.0:1789892551.792396:0:215397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215397:1876834915910272:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892551.792439:0:215397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:1.0:1789892551.792558:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:1.0:1789892551.792587:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892551.792623:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.792638:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892551.792650:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892551.792653:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 197 10000000:01000000:1.0:1789892551.792657:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892551.792680:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.792692:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.792702:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.792723:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.792768:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.792814:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.792820:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910400 00000100:00100000:2.0:1789892551.792826:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910400 00000100:00100000:2.0:1789892551.792855:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:2.0:1789892551.792860:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915910400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.792867:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.792877:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213614 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.792893:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.792902:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.792927:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffc00, rc 0) 00000100:00100000:2.0:1789892551.792969:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915910400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.792977:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:1.0:1789892551.793027:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892551.793043:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.793052:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.793115:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.793152:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.793173:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.793201:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910528 00000100:00100000:2.0:1789892551.793207:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910528 00000100:00100000:2.0:1789892551.793236:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:2.0:1789892551.793260:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915910528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.793346:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915910528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.793355:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:1.0:1789892551.793403:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.793437:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.793477:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892551.793511:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910656 00000100:00100000:2.0:1789892551.793524:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910656 00000100:00100000:2.0:1789892551.793565:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:1.0:1789892551.793570:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.793571:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915910656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.793669:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915910656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.793676:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:1.0:1789892551.793701:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915910656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.794162:0:215398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215398:1876834915910784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892551.794219:0:215398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.794247:0:215398:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.794270:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910784 00000100:00100000:2.0:1789892551.794275:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910784 00000100:00100000:2.0:1789892551.794302:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:2.0:1789892551.794307:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215398:x1876834915910784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.794412:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215398:x1876834915910784:12345-0@lo:502:llog_process_th.0 Request processed in 104us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.794420:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:1.0:1789892551.794479:0:215398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215398:1876834915910784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892551.794563:0:215398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892551.794607:0:215398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892551.794611:0:215398:0:(obd_config.c:1561:class_process_config()) marker 187 (0x1) lustre-MDT0001-m add lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:1.0:1789892551.794618:0:215398:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1789892551.794639:0:215398:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool2 as member 1 00000100:00100000:1.0:1789892551.794664:0:215398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215398:1876834915910912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892551.794715:0:215398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.794753:0:215398:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.794764:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915910912 00000100:00100000:2.0:1789892551.794769:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915910912 00000100:00100000:2.0:1789892551.794795:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1789892551.794817:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215398:x1876834915910912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.794892:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215398:x1876834915910912:12345-0@lo:502:llog_process_th.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.794901:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:1.0:1789892551.794947:0:215398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215398:1876834915910912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892551.795001:0:215398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892551.795009:0:215398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892551.795011:0:215398:0:(obd_config.c:1561:class_process_config()) marker 187 (0x2) lustre-MDT0001-m add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892551.795016:0:215398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 200 count 196 00000020:01000000:0.0:1789892551.795099:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 197-199 (rc=0) 10000000:01000000:0.0:1789892551.795152:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892551.795160:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.795169:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892551.795176:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892551.795178:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 171 10000000:01000000:0.0:1789892551.795181:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892551.795198:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.795206:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.795214:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.795227:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.795282:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.795302:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.795323:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911040 00000100:00100000:2.0:1789892551.795328:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911040 00000100:00100000:2.0:1789892551.795357:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:2.0:1789892551.795363:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915911040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.795370:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.795378:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213622 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.795402:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.795410:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.795417:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe600, rc 0) 00000100:00100000:2.0:1789892551.795452:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915911040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.795458:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1789892551.795514:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892551.795536:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.795548:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.795605:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.795640:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.795670:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.795700:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911168 00000100:00100000:2.0:1789892551.795707:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911168 00000100:00100000:2.0:1789892551.795738:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:2.0:1789892551.795743:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915911168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.795819:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915911168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.795827:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1789892551.795877:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.795933:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.796000:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.796023:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.796058:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911296 00000100:00100000:2.0:1789892551.796081:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911296 00000100:00100000:2.0:1789892551.796110:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:2.0:1789892551.796116:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915911296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.796189:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915911296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.796197:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1789892551.796225:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.796627:0:215399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215399:1876834915911424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.796667:0:215399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.796698:0:215399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.796719:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911424 00000100:00100000:2.0:1789892551.796725:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911424 00000100:00100000:2.0:1789892551.796767:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:2.0:1789892551.796776:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215399:x1876834915911424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.796902:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215399:x1876834915911424:12345-0@lo:502:llog_process_th.0 Request processed in 125us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.796913:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:0.0:1789892551.796930:0:215399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215399:1876834915911424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.796976:0:215399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215399:1876834915911552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892551.797017:0:215399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.797046:0:215399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.797059:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911552 00000100:00100000:2.0:1789892551.797082:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911552 00000100:00100000:2.0:1789892551.797116:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1789892551.797125:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215399:x1876834915911552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.797212:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215399:x1876834915911552:12345-0@lo:502:llog_process_th.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.797222:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1789892551.797229:0:215399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215399:1876834915911552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892551.797253:0:215399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:1.0:1789892551.797324:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:1.0:1789892551.797357:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892551.797365:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.797377:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892551.797388:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892551.797391:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 197 10000000:01000000:1.0:1789892551.797395:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892551.797416:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.797427:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.797438:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.797458:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.797519:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.797543:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.797574:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911680 00000100:00100000:2.0:1789892551.797581:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911680 00000100:00100000:2.0:1789892551.797618:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1789892551.797626:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915911680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.797637:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.797649:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213630 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.797680:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.797694:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.797705:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff000, rc 0) 00000100:00100000:2.0:1789892551.797751:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915911680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.797764:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:1.0:1789892551.797796:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892551.797814:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892551.797826:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.797876:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.797920:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.797940:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.797965:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911808 00000100:00100000:2.0:1789892551.797970:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911808 00000100:00100000:2.0:1789892551.797996:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:2.0:1789892551.798001:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915911808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.798099:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915911808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.798106:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:1.0:1789892551.798112:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.798145:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.798179:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.798198:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.798210:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915911936 00000100:00100000:2.0:1789892551.798215:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915911936 00000100:00100000:2.0:1789892551.798240:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:2.0:1789892551.798245:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915911936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.798319:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915911936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.798326:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00100000:1.0:1789892551.798350:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915911936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892551.798603:0:215400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215400:1876834915912064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892551.798638:0:215400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892551.798661:0:215400:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.798688:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912064 00000100:00100000:2.0:1789892551.798693:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912064 00000100:00100000:2.0:1789892551.798720:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1789892551.798726:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215400:x1876834915912064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.798813:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215400:x1876834915912064:12345-0@lo:502:llog_process_th.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.798821:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:1.0:1789892551.798831:0:215400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215400:1876834915912064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892551.798867:0:215400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892551.798877:0:215400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892551.798879:0:215400:0:(obd_config.c:1561:class_process_config()) marker 186 (0x1) lustre-MDT0000-m add lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:1.0:1789892551.798886:0:215400:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1789892551.798898:0:215400:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool2 as member 1 00000020:01000004:1.0:1789892551.799247:0:215401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892551.799253:0:215401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:3.0:1789892551.799277:0:215400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215400:1876834915912192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892551.799330:0:215400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892551.799359:0:215400:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069882ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.799371:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912192 00000100:00100000:2.0:1789892551.799376:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912192 00000100:00100000:2.0:1789892551.799411:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1789892551.799421:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215400:x1876834915912192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892551.799553:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215400:x1876834915912192:12345-0@lo:502:llog_process_th.0 Request processed in 131us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.799564:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:3.0:1789892551.799578:0:215400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215400:1876834915912192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892551.799619:0:215400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892551.799625:0:215400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892551.799628:0:215400:0:(obd_config.c:1561:class_process_config()) marker 186 (0x2) lustre-MDT0000-m add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789892551.799632:0:215400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 200 count 196 00000020:01000000:0.0:1789892551.799703:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 197-199 (rc=0) 10000000:01000000:0.0:1789892551.799729:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789892551.799734:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.799742:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892551.799748:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789892551.799750:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:0.0:1789892551.799753:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789892551.799767:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.799774:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.799781:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.799793:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915912320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.799818:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.799849:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.799873:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912320 00000100:00100000:2.0:1789892551.799878:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912320 00000100:00100000:2.0:1789892551.799911:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1789892551.799920:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915912320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892551.799930:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892551.799940:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021363e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.799959:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.799971:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892551.799981:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff200, rc 0) 00000100:00100000:2.0:1789892551.800019:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915912320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.800027:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:0.0:1789892551.800053:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915912320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892551.800085:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.800112:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892551.800153:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915912448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892551.800178:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892551.800200:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892551.800232:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912448 00000100:00100000:2.0:1789892551.800238:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912448 00000100:00100000:2.0:1789892551.800271:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:2.0:1789892551.800279:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915912448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.800344:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915912448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (163us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892551.800364:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915912448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892551.800367:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 10000000:01000000:0.0:1789892551.800393:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789892551.800400:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892551.800411:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892551.970817:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915912576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892551.970937:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892551.971012:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912576 00000100:00100000:2.0:1789892551.971025:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912576 00000100:00100000:2.0:1789892551.971146:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789892551.971159:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915912576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789892551.971230:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:2.0:1789892551.971307:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915912576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892551.971315:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789892551.971356:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915912576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892552.482721:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915912832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892552.482769:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915912960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892552.482819:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915913216:0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.482838:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892552.482895:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.482914:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915913344:0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.482924:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915912704:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.482938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892552.482970:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915913472:0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.482998:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892552.483006:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915913600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892552.483027:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.483067:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915913856:0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.483096:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.483147:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892552.483153:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915913088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892552.483164:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915913984:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.483189:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.483192:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1876834915914368:0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.483263:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892552.483268:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892552.483279:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876834915914112:0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.483281:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892552.483326:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915913728:0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.483343:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915914496:0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.483378:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912832 00000100:00100000:1.0:1789892552.483380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.483391:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912832 00000100:00100000:2.0:1789892552.483401:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912704 00000100:00100000:2.0:1789892552.483411:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912704 00000100:00100000:3.0:1789892552.483429:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915912960 00000100:00100000:3.0:1789892552.483443:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915912960 00000100:00100000:1.0:1789892552.483479:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1876834915914624:0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.483527:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913600 00000100:00100000:0.0:1789892552.483534:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913600 00000100:00100000:2.0:1789892552.483535:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:2.0:1789892552.483559:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915912704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.483586:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913088 00000100:00100000:0.0:1789892552.483598:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789892552.483600:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913088 00000100:00100000:1.0:1789892552.483612:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.483622:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915912832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892552.483645:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915912704:12345-0@lo:400:kworker.0 Request processed in 89us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892552.483663:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00002000:00000024:0.0:1789892552.483666:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892552.483674:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789892552.483700:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915912960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892552.483724:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913216 00002000:00000024:3.0:1789892552.483733:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892552.483737:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913216 00000100:00100000:2.0:1789892552.483765:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913344 00000100:00100000:0.0:1789892552.483769:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915912832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892552.483773:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913344 00000100:00100000:0.0:1789892552.483798:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789892552.483826:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915912960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892552.483839:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789892552.483848:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913472 00000100:00100000:3.0:1789892552.483849:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789892552.483861:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913472 00000100:00100000:1.0:1789892552.483866:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915913216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.483867:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789892552.483897:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789892552.483898:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915913600:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892552.483915:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913856 00000100:00100000:3.0:1789892552.483921:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876834915913088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892552.483924:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913856 00002000:00000024:0.0:1789892552.483929:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789892552.483955:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892552.483958:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913984 00000100:00100000:2.0:1789892552.483975:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913984 00000100:00100000:1.0:1789892552.483997:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915913216:12345-0@lo:400:kworker.0 Request processed in 132us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892552.484014:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1876834915913600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892552.484020:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789892552.484025:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789892552.484040:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876834915913088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892552.484045:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789892552.484071:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1876834915913344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.484130:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789892552.484152:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789892552.484173:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914368 00000100:00100000:0.0:1789892552.484182:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915913472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.484189:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914368 00000100:00100000:2.0:1789892552.484210:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915913344:12345-0@lo:400:kworker.0 Request processed in 156us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892552.484224:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789892552.484294:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789892552.484316:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689ae85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915913472:12345-0@lo:400:kworker.0 Request processed in 139us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892552.484325:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915913856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.484326:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914112 00000100:00100000:1.0:1789892552.484329:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914624 00000100:00100000:0.0:1789892552.484338:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789892552.484340:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914112 00000100:00100000:1.0:1789892552.484343:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914624 00000100:00100000:0.0:1789892552.484390:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789892552.484411:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915913984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.484422:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915913856:12345-0@lo:400:kworker.0 Request processed in 115us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892552.484434:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789892552.484443:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789892552.484468:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789892552.484494:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915913984:12345-0@lo:400:kworker.0 Request processed in 87us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892552.484497:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876834915914368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.484512:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789892552.484531:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876834915914112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.484615:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.484637:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914496 00000100:00100000:0.0:1789892552.484645:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914496 00000100:00100000:1.0:1789892552.484672:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876834915914112:12345-0@lo:400:kworker.0 Request processed in 172us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892552.484705:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876834915914368:12345-0@lo:400:kworker.0 Request processed in 231us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892552.484706:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789892552.484708:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915912960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892552.484747:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1789892552.484762:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789892552.484787:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789892552.484797:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876834915914624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.484801:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915913472:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.484834:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915914496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.484857:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915913984:0@lo:400:kworker.0 00010000:00010000:3.0:1789892552.484864:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789892552.484899:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789892552.484913:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892552.484925:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789892552.484933:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789892552.484946:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876834915914624:12345-0@lo:400:kworker.0 Request processed in 157us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892552.484962:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1789892552.484968:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915913344:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.484999:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915914496:12345-0@lo:400:kworker.0 Request processed in 183us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892552.485013:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915913856:0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.485031:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892552.485088:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00010000:00080000:2.0:1789892552.485128:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688347ad80 x1876834915914368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892552.485144:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915914496:0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.485149:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1876834915914368:0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.485166:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915914240:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.485172:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915913728 00000100:00100000:1.0:1789892552.485200:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915913728 00000100:00100000:2.0:1789892552.485217:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915912832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892552.485255:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892552.485289:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876834915914112:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.485312:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914240 00000100:00100000:1.0:1789892552.485324:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914240 00010000:00080000:0.0:1789892552.485351:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90688347b100 x1876834915914624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892552.485373:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1876834915914624:0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.485377:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789892552.485381:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915912704:0@lo:400:kworker.0 00000100:00100000:2.0:1789892552.485413:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915913728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892552.485458:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915913216:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.485461:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1789892552.485519:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915913600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892552.485551:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688243bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915914240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.485558:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915913088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892552.485597:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915913728:12345-0@lo:400:kworker.0 Request processed in 118us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892552.485617:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789892552.485641:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915913728:0@lo:400:kworker.0 00000100:00100000:3.0:1789892552.485699:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915914240:0@lo:400:kworker.0 00000100:00100000:1.0:1789892552.485713:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688243bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915914240:12345-0@lo:400:kworker.0 Request processed in 206us (456us total) trans 0 rc 0/0 00000100:00080000:2.0:1789892552.485733:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892552.485734:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789892552.774757:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892552.774837:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854848 00000100:00100000:0.0:1789892552.774847:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854848 00000100:00100000:0.0:1789892552.774923:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2796 00000100:00100000:0.0:1789892552.774933:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:214011:x1876834925854848:12345-192.168.204.33@tcp:48:lfs.0 00000100:00080000:1.0:1789892552.775026:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892552.777394:0:191771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883479880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:191771:1876834915914752:0@lo:19:mdt00_004.0 00000100:00100000:2.0:1789892552.777444:0:191771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892552.777475:0:191771:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a02236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892552.777482:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914752 00000100:00100000:0.0:1789892552.777505:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914752 00000100:00100000:0.0:1789892552.777555:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789892552.777577:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:191771:x1876834915914752:12345-0@lo:19:mdt00_004.0 00000100:00100000:0.0:1789892552.777750:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:191771:x1876834915914752:12345-0@lo:19:mdt00_004.0 Request processed in 184us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892552.777757:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789892552.777783:0:191771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883479880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:191771:1876834915914752:0@lo:19:mdt00_004.0 00000100:00100000:1.0:1789892552.777888:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:214011:x1876834925854848:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 2934us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892552.777902:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2796 00000100:00100000:2.0:1789892552.779005:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892552.779062:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925854976 00000100:00100000:0.0:1789892552.779076:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925854976 00000100:00100000:0.0:1789892552.779122:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2797 00000100:00100000:0.0:1789892552.779132:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:214011:x1876834925854976:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:0.0:1789892552.781267:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:214011:x1876834925854976:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 2137us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892552.781275:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2797 00010000:00010000:1.0:1789892553.506899:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789892553.753299:0:215549:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3378901805523ns, next at 3277500567060ns, rc = 0 00080000:00080000:0.0:1789892553.753313:0:215549:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892553.753393:0:215549:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3378901901419ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892553.753398:0:215549:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789892553.753464:0:215549:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3378901972456ns, next at 3206864919340ns, rc = 0 00080000:00080000:0.0:1789892553.753469:0:215549:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892553.753941:0:215549:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3378902449346ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892553.753946:0:215549:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789892553.754108:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000004:00080000:3.0:1789892553.754570:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 36 committed 00000004:00080000:1.0:1789892553.754666:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000004:00080000:3.0:1789892553.755053:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 36 committed 00000100:00100000:2.0:1789892554.235083:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892554.235151:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855104 00000100:00100000:3.0:1789892554.235166:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855104 00000100:00080000:2.0:1789892554.235245:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892554.235279:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2798 00000100:00100000:3.0:1789892554.235293:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:214202:x1876834925855104:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892554.235430:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:214202:x1876834925855104:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892554.235439:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2798 00000100:00100000:3.0:1789892554.245188:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892554.245248:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855232 00000100:00100000:1.0:1789892554.245259:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855232 00000100:00100000:1.0:1789892554.245306:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2799 00000100:00100000:1.0:1789892554.245315:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688243a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:214204:x1876834925855232:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:1.0:1789892554.245393:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688243a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:214204:x1876834925855232:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892554.245400:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2799 00010000:00010000:0.0:1789892554.530660:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892554.639305:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892554.639359:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892554.639363:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855360 00000100:00100000:3.0:1789892554.639373:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855360 00000100:00100000:1.0:1789892554.639397:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855488 00000100:00100000:1.0:1789892554.639403:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855488 00000100:00100000:3.0:1789892554.639423:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2208 00000100:00100000:3.0:1789892554.639435:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925855360:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:2.0:1789892554.639441:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892554.639460:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 481 00000100:00100000:1.0:1789892554.639473:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925855488:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1789892554.639526:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925855360:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892554.639533:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2208 00000100:00100000:1.0:1789892554.639550:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925855488:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892554.639558:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 481 00000001:02000400:0.0:1789892554.735274:0:215645:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_71b: @@@@@@ FAIL: Used space(10240) for user quota_usr isn't 0. Debug log: 12886 lines, 12886 kept, 0 dropped, 0 bad.