00010000:00010000:3.0F:1789892555.554631:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1789892556.578690:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915914880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789892556.578752:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892556.578762:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892556.578809:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915914880 00000100:00100000:3.0:1789892556.578818:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915914880 00000100:00100000:3.0:1789892556.578874:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789892556.578886:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915914880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789892556.578921:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789892556.578997:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915914880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892556.579006:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789892556.579021:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915914880:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1789892556.715899:0:215939:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe123fb360 20000000:00000080:0.0:1789892556.715917:0:215939:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff906998014400 uarg=0000000000000000 00000040:00100000:0.0:1789892556.716658:0:215939:0:(llog.c:1072:llog_reverse_process()) index 173 : idx 137 20000000:01000000:0.0:1789892556.716666:0:215939:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 163 cmd:0xce021 lustre.qpool1 lustre-OST0000_UUID 20000000:01000000:0.0:1789892556.716682:0:215939:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1789892556.717006:0:215940:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 176 1->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:0.0:1789892556.717071:0:215940:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 164 marker 176 2->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789892556.717096:0:215940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000040:00080000:1.0F:1789892556.717231:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].174, 224 off40008 20000000:01000000:1.0:1789892556.717250:0:215939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892556.717263:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].175, 128 off40136 00000040:00080000:1.0:1789892556.717273:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].176, 224 off40360 20000000:01000000:1.0:1789892556.717284:0:215939:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:1.0:1789892556.717562:0:215941:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 188 marker 177 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:1.0:1789892556.717579:0:215941:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 190 marker 177 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:1.0:1789892556.717590:0:215941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 200 count 196 00000040:00080000:0.0:1789892556.717700:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].200, 224 off44816 20000000:01000000:0.0:1789892556.717713:0:215939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:0.0:1789892556.717729:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].201, 136 off44952 00000040:00080000:0.0:1789892556.717751:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].202, 224 off45176 20000000:01000000:0.0:1789892556.717765:0:215939:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1789892556.718009:0:215942:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 188 marker 178 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:0.0:1789892556.718027:0:215942:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 190 marker 178 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789892556.718037:0:215942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 200 count 196 00000040:00080000:1.0:1789892556.718122:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].200, 224 off44816 20000000:01000000:1.0:1789892556.718130:0:215939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892556.718139:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].201, 136 off44952 00000040:00080000:1.0:1789892556.718152:0:215939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].202, 224 off45176 10000000:01000000:1.0:1789892556.718161:0:215939:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892556.718176:0:215939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718192:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718199:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718204:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718209:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718213:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718225:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718231:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718239:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718246:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718253:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718261:0:215939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718269:0:215939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718309:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718324:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 23 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.718340:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915008:0@lo:104: 00000100:00100000:1.0:1789892556.718399:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892556.718441:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915008 00000100:00100000:0.0:1789892556.718448:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915008 00010000:00010000:1.0:1789892556.718465:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718474:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 23 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.718482:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915136:0@lo:104: 00000100:00100000:1.0:1789892556.718533:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892556.718568:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0F:1789892556.718574:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915136 00010000:00010000:1.0:1789892556.718576:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 23 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.718587:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915136 00000100:00100000:1.0:1789892556.718588:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915264:0@lo:104: 00000100:00100000:1.0:1789892556.718619:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892556.718651:0:189423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892556.718659:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915264 00000100:00100000:1.0:1789892556.718663:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915264 00000100:00100000:0.0:1789892556.718757:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1789892556.718772:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215939:x1876834915915008:12345-0@lo:104: 00000100:00100000:3.0:1789892556.718779:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1789892556.718787:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00010000:00010000:0.0:1789892556.718788:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.718793:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215939:x1876834915915136:12345-0@lo:104: 00000100:00100000:2.0:1789892556.718803:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688c60c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215939:x1876834915915264:12345-0@lo:104: 00010000:00010000:3.0:1789892556.718809:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718813:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.718814:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.718841:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 23 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.718854:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915392:0@lo:104: 00010000:00010000:0.0:1789892556.718868:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892556.718878:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215939:x1876834915915008:12345-0@lo:104: Request processed in 109us (477us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892556.718881:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892556.718889:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215939:x1876834915915136:12345-0@lo:104: Request processed in 101us (357us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892556.718891:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892556.718903:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892556.718904:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1789892556.718910:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688c60c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215939:x1876834915915264:12345-0@lo:104: Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892556.718914:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1789892556.718924:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789892556.718934:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915392 00000100:00100000:0.0:1789892556.718940:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915392 00010000:00010000:3.0:1789892556.718945:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892556.718952:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.718959:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837200 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892556.718961:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892556.718976:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.718989:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00010000:00010000:3.0:1789892556.719001:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719004:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 23 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719008:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915915392:12345-0@lo:104: 00010000:00010000:0.0:1789892556.719014:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892556.719025:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.719026:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719040:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915520:0@lo:104: 10000000:00010000:3.0:1789892556.719041:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719054:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800800 already unused, calling callback (ffffffffc112ec20) 10000000:01000000:3.0:1789892556.719055:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892556.719064:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719077:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719089:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892556.719090:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892556.719090:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.719092:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892556.719106:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915915392:12345-0@lo:104: Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892556.719112:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915520 00010000:00010000:3.0:1789892556.719114:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789892556.719118:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892556.719119:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915520 00000100:00100000:2.0:1789892556.719124:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:3.0:1789892556.719139:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719147:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837200/0x5c4f93dd0021363e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213645 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719147:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00010000:00010000:0.0:1789892556.719150:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719162:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915915520:12345-0@lo:104: 00010000:00010000:3.0:1789892556.719172:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892556.719173:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719175:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892556.719176:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719178:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719201:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836400 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892556.719202:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 23 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719203:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892556.719207:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.719223:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892556.719236:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719236:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915904:0@lo:104: 00000100:00100000:2.0:1789892556.719237:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915915520:12345-0@lo:104: Request processed in 76us (147us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892556.719237:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213637 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719258:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 10000000:00010000:3.0:1789892556.719261:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719269:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892556.719270:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892556.719278:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892556.719279:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719284:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915904 00000100:00100000:2.0:1789892556.719289:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915904 00010000:00010000:1.0:1789892556.719299:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719300:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800c00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892556.719306:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892556.719309:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719313:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 23 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719319:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00010000:00010000:3.0:1789892556.719328:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892556.719333:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915915904:12345-0@lo:104: 00010000:00010000:3.0:1789892556.719340:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719342:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719343:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916032:0@lo:104: 00010000:00010000:2.0:1789892556.719344:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719363:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213629 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892556.719373:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719374:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892556.719384:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1789892556.719386:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892556.719389:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719397:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892556.719400:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719406:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.719407:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892556.719411:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719417:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719420:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915915904:12345-0@lo:104: Request processed in 87us (152us total) trans 0 rc 0/0 10000000:00010000:3.0:1789892556.719422:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719440:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 23 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719445:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892556.719447:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 10000000:01000000:3.0:1789892556.719452:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892556.719462:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719467:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916288:0@lo:104: 00000100:00100000:2.0:1789892556.719470:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916032 00000100:00100000:2.0:1789892556.719478:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916032 00010000:00010000:3.0:1789892556.719479:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719480:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800c00/0x5c4f93dd00213614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021361b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719525:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892556.719527:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00010000:00010000:0.0:1789892556.719529:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892556.719533:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892556.719535:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719537:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719543:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915916032:12345-0@lo:104: 00010000:00010000:2.0:1789892556.719556:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719558:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892556.719566:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719573:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719584:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd00213606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021360d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719599:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 23 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719603:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892556.719607:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892556.719610:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892556.719612:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892556.719620:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719622:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915916032:12345-0@lo:104: Request processed in 83us (251us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892556.719625:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719627:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916672:0@lo:104: 00010000:00010000:3.0:1789892556.719641:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837400 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892556.719642:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 10000000:00010000:3.0:1789892556.719648:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892556.719652:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719656:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719658:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916288 00000100:00100000:2.0:1789892556.719663:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916288 00000100:00100000:1.0:1789892556.719675:0:215939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789892556.719675:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789892556.719677:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719682:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 10000000:01000000:3.0:1789892556.719690:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892556.719695:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915916288:12345-0@lo:104: 00010000:00010000:2.0:1789892556.719701:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719706:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719711:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719713:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719731:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892556.719736:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892556.719744:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719746:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719746:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 9 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.719756:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892556.719769:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915916288:12345-0@lo:104: Request processed in 75us (241us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892556.719772:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f801800/0x5c4f93dd002135f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135ff expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719773:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd002135ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135f1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719780:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916928:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892556.719781:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789892556.719794:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916672 00000100:00100000:2.0:1789892556.719798:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916672 00010000:00010000:0.0:1789892556.719804:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892556.719810:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.719811:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892556.719816:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892556.719819:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892556.719822:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00010000:00010000:0.0:1789892556.719825:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892556.719830:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915916672:12345-0@lo:104: 10000000:00010000:0.0:1789892556.719830:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.719835:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915915648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892556.719843:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.719855:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719863:0:215939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892556.719868:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.719877:0:215939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 9 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.719886:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789892556.719897:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892556.719899:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892556.719906:0:215939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915917184:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892556.719911:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215939:x1876834915916672:12345-0@lo:104: Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892556.719918:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915916544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892556.719922:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.719924:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00010000:00010000:0.0:1789892556.719934:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892556.719942:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719946:0:215939:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892556.719949:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892556.719951:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892556.719977:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800200/0x5c4f93dd002135dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135e3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.719978:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.719992:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915008:0@lo:104: 00000100:00100000:3.0:1789892556.719993:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:2.0:1789892556.720001:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837a00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892556.720008:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915916416:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892556.720008:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.720008:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892556.720014:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892556.720020:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915136:0@lo:104: 00010000:00010000:0.0:1789892556.720020:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892556.720027:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.720034:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789892556.720035:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.720042:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892556.720042:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915264:0@lo:104: 10000000:01000000:2.0:1789892556.720056:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892556.720066:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915915776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.720068:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915392:0@lo:104: 00000100:00100000:3.0:1789892556.720072:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915917312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892556.720084:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720090:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892556.720095:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915520:0@lo:104: 00010000:00010000:2.0:1789892556.720103:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720114:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002135ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002135d5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.720125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892556.720128:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915915904:0@lo:104: 00010000:00010000:2.0:1789892556.720130:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892556.720134:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892556.720139:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892556.720147:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916032:0@lo:104: 00010000:00010000:2.0:1789892556.720148:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892556.720164:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915648 00000100:00100000:2.0:1789892556.720168:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915648 00000100:00100000:1.0:1789892556.720169:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916288:0@lo:104: 00000100:00100000:0.0:1789892556.720175:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915916800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.720187:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916672:0@lo:104: 00010000:00010000:2.0:1789892556.720188:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 24 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.720216:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892556.720219:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916544 00000100:00100000:2.0:1789892556.720223:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916544 00010000:00010000:2.0:1789892556.720236:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 25 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.720248:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916416 00000100:00100000:2.0:1789892556.720251:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916416 00000100:00100000:1.0:1789892556.720253:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915916160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892556.720262:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915915776 00010000:00010000:2.0:1789892556.720264:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 26 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.720268:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915915776 00000100:00100000:2.0:1789892556.720284:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916800 00010000:00010000:3.0:1789892556.720290:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 27 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.720294:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916800 00000100:00100000:0.0:1789892556.720299:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1789892556.720301:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892556.720312:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 28 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.720317:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3622:x1876834915915648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.720323:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915917056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892556.720331:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915916160 00000100:00100000:2.0:1789892556.720335:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915916160 00010000:00010000:0.0:1789892556.720335:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892556.720346:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 29 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720351:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 29 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.720364:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892556.720373:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 29 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.720379:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917056 00000100:00100000:2.0:1789892556.720383:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917056 00000100:00100000:3.0:1789892556.720394:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00010000:00010000:2.0:1789892556.720398:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 30 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.720410:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3622:x1876834915916544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892556.720422:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892556.720425:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff200/0x5c4f93dd00213645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021363e expref: 30 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.720426:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00010000:00010000:3.0:1789892556.720432:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 30 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.720440:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1789892556.720455:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3622:x1876834915916416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892556.720457:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 29 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.720459:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3619:x1876834915916800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892556.720474:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892556.720478:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892556.720479:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892556.720485:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffee00/0x5c4f93dd0021360d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213606 expref: 29 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720511:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 29 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.720526:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 29 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720527:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 29 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720564:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd002135ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002135f8 expref: 28 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.720568:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 28 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.720586:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892556.720594:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892556.720596:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffc00/0x5c4f93dd0021361b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213614 expref: 27 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.720600:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3622:x1876834915915648:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (715us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892556.720614:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892556.720615:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1789892556.720639:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915916544:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892556.720646:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789892556.720648:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3619:x1876834915916800:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892556.720657:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1789892556.720665:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915916160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892556.720666:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1789892556.720666:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915916416:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892556.720684:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:0.0:1789892556.720685:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892556.720692:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00010000:00010000:0.0:1789892556.720695:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 23 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.720711:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3619:x1876834915915776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.720713:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00010000:00010000:0.0:1789892556.720713:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 22 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720723:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892556.720731:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 22 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.720731:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915917056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892556.720735:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe600/0x5c4f93dd00213629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213622 expref: 22 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720744:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 22 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.720760:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892556.720764:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892556.720768:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892556.720772:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 21 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.720773:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff000/0x5c4f93dd00213637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213630 expref: 21 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.720778:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789892556.720791:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915917440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892556.720796:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892556.720803:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 20 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.720815:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3620:x1876834915916160:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (519us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892556.720821:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffa00/0x5c4f93dd002135f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002135ea expref: 20 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.720831:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1789892556.720839:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892556.720840:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3619:x1876834915915776:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (714us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892556.720843:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892556.720850:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1789892556.720860:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917440 00000100:00100000:0.0:1789892556.720867:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917440 00010000:00010000:0.0:1789892556.720889:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 18 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.720891:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3620:x1876834915917056:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892556.720907:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789892556.720928:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915916160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.720931:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789892556.720944:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3621:x1876834915917440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892556.720948:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915917056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892556.720958:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892556.720978:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 17 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892556.720986:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 17 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.721002:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915915776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892556.721003:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002135d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002135ce expref: 17 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.721015:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892556.721021:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915916800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892556.721025:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892556.721054:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915915648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892556.721055:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917312 00000100:00100000:2.0:1789892556.721060:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917312 00000100:00100000:3.0:1789892556.721071:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915916544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892556.721078:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 17 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892556.721078:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3621:x1876834915917440:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892556.721101:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915916416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892556.721101:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915917440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.721108:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1789892556.721118:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1789892556.721128:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3622:x1876834915917312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892556.721135:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892556.721138:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 16 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.721155:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 16 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.721163:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe800/0x5c4f93dd002135e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002135dc expref: 16 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.721170:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892556.721197:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915917312:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892556.721202:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789892556.721276:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915917312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892556.721341:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915916928:192.168.204.33@tcp:104: 00000100:00100000:1.0:1789892556.721348:0:215939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215939:1876834915917184:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892556.721381:0:215939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892556.721742:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892556.721764:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892556.721804:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855616 00000100:00100000:3.0:1789892556.721807:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855744 00000100:00100000:0.0:1789892556.721811:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855616 00000100:00100000:3.0:1789892556.721813:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855744 00010000:00010000:0.0:1789892556.721836:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 11 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.721840:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 11 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.721887:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 526 00000100:00100000:3.0:1789892556.721896:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 527 00000100:00100000:0.0:1789892556.721903:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925855616:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789892556.721913:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925855744:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892556.721916:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892556.721926:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892556.721927:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 11 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.721941:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 11 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.721946:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 11 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.721981:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 11 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.721997:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd002135c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a637 expref: 11 pid: 189432 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722000:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffe00/0x5c4f93dd002135c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a63e expref: 11 pid: 189434 timeout: 3481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722020:0:199151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722027:0:199151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892556.722033:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892556.722037:0:199151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722044:0:199151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722050:0:199151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722055:0:199151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722059:0:199151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800e00 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:3.0:1789892556.722062:0:199151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722068:0:199151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892556.722074:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2400:x1876834925855616:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 177us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892556.722093:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 526 00010000:00010000:3.0:1789892556.722108:0:199151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892556.722122:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892556.722125:0:215939:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.722134:0:215939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892556.722140:0:215939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800e00/0x5c4f93dd0021364c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892556.722163:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925855744:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 253us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892556.722173:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 527 00000100:00100000:2.0:1789892557.090712:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915917568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892557.090774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892557.090832:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917568 00000100:00100000:3.0:1789892557.090842:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917568 00000100:00100000:3.0:1789892557.090900:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789892557.090912:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915917568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789892557.090948:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:3.0:1789892557.091023:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915917568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.091032:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789892557.091070:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915917568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892557.602736:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915917952:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789892557.602758:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892557.602767:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915918208:0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.602781:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915918080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892557.602819:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892557.602826:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.602828:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915918336:0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.602848:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917952 00000100:00100000:0.0:1789892557.602855:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917952 00000100:00100000:1.0:1789892557.602873:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915917824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892557.602878:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915918720:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.602886:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.602917:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915918848:0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.602928:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789892557.602933:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.602940:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892557.602940:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915917952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789892557.602992:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892557.602993:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.602997:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915917696:0@lo:400:kworker.0 00000100:00100000:3.0:1789892557.602999:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915919232:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603020:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915919360:0@lo:400:kworker.0 00000100:00100000:3.0:1789892557.603054:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892557.603061:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915917952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892557.603067:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.603069:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918336 00000100:00100000:0.0:1789892557.603074:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789892557.603075:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918336 00000100:00100000:0.0:1789892557.603096:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917824 00000100:00100000:3.0:1789892557.603097:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789892557.603102:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917824 00000100:00100000:3.0:1789892557.603111:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915918592:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603121:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918848 00000100:00100000:2.0:1789892557.603125:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918848 00000100:00100000:0.0:1789892557.603139:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789892557.603151:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915917824:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892557.603156:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915917952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892557.603162:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.603162:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789892557.603176:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915918336:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789892557.603178:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892557.603197:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876834915919104:0@lo:400:kworker.0 00000100:00100000:1.0:1789892557.603204:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915917696 00000100:00100000:1.0:1789892557.603212:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915917696 00000100:00100000:2.0:1789892557.603223:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915918336:12345-0@lo:400:kworker.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.603229:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789892557.603243:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915917824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.603246:0:191928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918592 00000100:00100000:2.0:1789892557.603250:0:191928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918592 00000100:00100000:0.0:1789892557.603254:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789892557.603259:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.603264:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1789892557.603278:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3621:x1876834915917696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789892557.603282:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892557.603283:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789892557.603289:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892557.603293:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1876834915919616:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603296:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915918848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.603303:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918720 00000100:00100000:0.0:1789892557.603308:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918720 00000100:00100000:1.0:1789892557.603341:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3621:x1876834915917696:12345-0@lo:400:kworker.0 Request processed in 64us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.603342:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919232 00000100:00100000:0.0:1789892557.603347:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919232 00000100:00100000:3.0:1789892557.603348:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.603354:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915918848:12345-0@lo:400:kworker.0 Request processed in 58us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892557.603361:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1789892557.603369:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789892557.603383:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919104 00000100:00100000:0.0:1789892557.603386:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919104 00000100:00100000:2.0:1789892557.603396:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789892557.603408:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918208 00000100:00100000:0.0:1789892557.603408:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919616 00000100:00100000:2.0:1789892557.603410:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915918592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.603413:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919616 00000100:00100000:3.0:1789892557.603417:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918208 00000100:00100000:1.0:1789892557.603423:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1789892557.603436:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3622:x1876834915918720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.603437:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1789892557.603450:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915919232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892557.603468:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789892557.603474:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915918592:12345-0@lo:400:kworker.0 Request processed in 68us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.603483:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915918208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603486:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789892557.603519:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915919232:12345-0@lo:400:kworker.0 Request processed in 72us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.603525:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789892557.603542:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3622:x1876834915918720:12345-0@lo:400:kworker.0 Request processed in 108us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.603552:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1789892557.603562:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3622:x1876834915919104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892557.603570:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1789892557.603571:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915918208:12345-0@lo:400:kworker.0 Request processed in 89us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.603582:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789892557.603584:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789892557.603597:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876834915919616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.603603:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3622:x1876834915919104:12345-0@lo:400:kworker.0 Request processed in 42us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.603610:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00080000:0.0:1789892557.603648:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892557.603652:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915918592:0@lo:400:kworker.0 00000100:00080000:0.0:1789892557.603653:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892557.603660:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1876834915919616:12345-0@lo:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.603675:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1876834915919104:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603680:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1789892557.603680:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892557.603697:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915917824:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789892557.603704:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906882607480 x1876834915919616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892557.603714:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915917696:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603720:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918080 00000100:00100000:1.0:1789892557.603721:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915918464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892557.603722:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1876834915919616:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603727:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918080 00000100:00100000:3.0:1789892557.603753:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915919232:0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.603754:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.603769:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789892557.603773:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892557.603779:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915918208:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603782:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915918080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789892557.603796:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892557.603799:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915918336:0@lo:400:kworker.0 00000100:00100000:3.0:1789892557.603808:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915918720:0@lo:400:kworker.0 00000100:00100000:1.0:1789892557.603814:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915918976:0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.603818:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915918848:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603838:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915918080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.603844:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789892557.603844:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789892557.603855:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915919488:0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.603864:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918464 00000100:00100000:1.0:1789892557.603864:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.603869:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918464 00000100:00100000:0.0:1789892557.603890:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.603901:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789892557.603912:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915918464:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892557.603924:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915918080:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789892557.603925:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892557.603931:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919360 00000100:00100000:0.0:1789892557.603935:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919360 00000100:00100000:3.0:1789892557.603966:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919488 00000100:00100000:3.0:1789892557.603973:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919488 00000100:00100000:1.0:1789892557.603978:0:190945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915918976 00000100:00100000:1.0:1789892557.603985:0:190945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915918976 00000100:00100000:2.0:1789892557.603988:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915918464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.603997:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789892557.604000:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1789892557.604011:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915919360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892557.604033:0:191928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789892557.604037:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1789892557.604046:0:191928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915918976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892557.604055:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915919488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.604055:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915919360:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.604069:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789892557.604079:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915918464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892557.604085:0:191928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915918976:12345-0@lo:400:kworker.0 Request processed in 44us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.604093:0:191928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1789892557.604094:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789892557.604100:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892557.604102:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915918976:0@lo:400:kworker.0 00000100:00100000:0.0:1789892557.604130:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915919488:0@lo:400:kworker.0 00000100:00100000:3.0:1789892557.604134:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915919488:12345-0@lo:400:kworker.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.604155:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00010000:00080000:0.0:1789892557.604156:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906882606a00 x1876834915919360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892557.604169:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915919360:0@lo:400:kworker.0 10000000:01000000:2.0:1789892557.730536:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892557.730541:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 174 10000000:01000000:2.0:1789892557.730545:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892557.730585:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.730611:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.730624:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.730653:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915919744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.730714:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.730753:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.730777:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919744 00000100:00100000:3.0:1789892557.730784:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919744 00000100:00100000:3.0:1789892557.730829:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:3.0:1789892557.730836:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915919744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892557.730848:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892557.730861:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213653 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.730881:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 16 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.730889:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 16 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.730896:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f800, rc 0) 00000100:00100000:3.0:1789892557.730959:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915919744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.730964:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:2.0:1789892557.731021:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915919744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.731036:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.731044:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.731096:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915919872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.731119:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.731139:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.731176:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915919872 00000100:00100000:0.0:1789892557.731182:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915919872 00000100:00100000:0.0:1789892557.731211:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:0.0:1789892557.731217:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915919872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.731324:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915919872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.731331:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:2.0:1789892557.731355:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915919872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.731380:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.731416:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.731432:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.731515:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920000 00000100:00100000:3.0:1789892557.731520:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920000 00000100:00100000:3.0:1789892557.731546:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:3.0:1789892557.731552:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915920000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.731640:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915920000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.731650:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:2.0:1789892557.731661:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892557.732004:0:215943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215943:1876834915920128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.732048:0:215943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.732075:0:215943:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.732125:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920128 00000100:00100000:0.0:1789892557.732130:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920128 00000100:00100000:0.0:1789892557.732155:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:0.0:1789892557.732161:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215943:x1876834915920128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.732243:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215943:x1876834915920128:12345-0@lo:502:llog_process_th.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.732249:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00100000:1.0:1789892557.732277:0:215943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215943:1876834915920128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.732322:0:215943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215943:1876834915920256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.732365:0:215943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.732388:0:215943:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.732411:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920256 00000100:00100000:3.0:1789892557.732421:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920256 00000100:00100000:3.0:1789892557.732442:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:3.0:1789892557.732448:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215943:x1876834915920256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.732522:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:215943:x1876834915920256:12345-0@lo:502:llog_process_th.0 Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.732527:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:1.0:1789892557.732557:0:215943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215943:1876834915920256:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892557.732583:0:215943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:2.0:1789892557.732689:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:2.0:1789892557.732717:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892557.732722:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.732730:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.732736:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892557.732738:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:2.0:1789892557.732739:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892557.732752:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.732757:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.732762:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.732772:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.732795:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.732816:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.732874:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920384 00000100:00100000:0.0:1789892557.732879:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920384 00000100:00100000:0.0:1789892557.732905:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:0.0:1789892557.732910:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915920384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892557.732917:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892557.732925:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213661 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.732938:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 17 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.732967:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 17 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.732972:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892557.733004:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915920384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.733009:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:2.0:1789892557.733033:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.733044:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.733053:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.733093:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.733130:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.733149:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.733174:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920512 00000100:00100000:3.0:1789892557.733180:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920512 00000100:00100000:3.0:1789892557.733208:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:3.0:1789892557.733214:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915920512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.733283:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915920512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.733288:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:2.0:1789892557.733313:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.733333:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.733367:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.733381:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.733442:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920640 00000100:00100000:0.0:1789892557.733448:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920640 00000100:00100000:0.0:1789892557.733474:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:0.0:1789892557.733481:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915920640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.733578:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915920640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.733594:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:2.0:1789892557.733607:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892557.734191:0:215944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:2.0:1789892557.734253:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892557.734270:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892557.734276:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.734286:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.734293:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892557.734295:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 174 10000000:01000000:2.0:1789892557.734298:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892557.734322:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.734331:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.734339:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.734353:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.734385:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.734403:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.734424:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920768 00000100:00100000:3.0:1789892557.734429:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920768 00000100:00100000:3.0:1789892557.734450:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:3.0:1789892557.734455:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915920768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892557.734461:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892557.734468:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021366f expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.734480:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 18 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.734487:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 18 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.734514:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e000, rc 0) 00000100:00100000:3.0:1789892557.734548:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915920768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.734553:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:2.0:1789892557.734578:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.734588:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.734593:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.734619:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.734636:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.734654:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.734671:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915920896 00000100:00100000:0.0:1789892557.734676:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915920896 00000100:00100000:0.0:1789892557.734699:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:0.0:1789892557.734704:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915920896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.734761:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915920896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.734767:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:2.0:1789892557.734778:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915920896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.734798:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.734834:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.734848:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.734877:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921024 00000100:00100000:3.0:1789892557.734888:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921024 00000100:00100000:3.0:1789892557.734919:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1789892557.734925:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915921024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.735004:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915921024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.735010:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:2.0:1789892557.735021:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892557.735186:0:215945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215945:1876834915921152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.735216:0:215945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.735235:0:215945:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.735248:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921152 00000100:00100000:0.0:1789892557.735252:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921152 00000100:00100000:0.0:1789892557.735272:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:0.0:1789892557.735277:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215945:x1876834915921152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.735355:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215945:x1876834915921152:12345-0@lo:502:llog_process_th.0 Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.735364:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1789892557.735365:0:215945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215945:1876834915921152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.735402:0:215945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215945:1876834915921280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.735426:0:215945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.735439:0:215945:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.735462:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921280 00000100:00100000:3.0:1789892557.735466:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921280 00000100:00100000:3.0:1789892557.735488:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1789892557.735514:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215945:x1876834915921280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.735574:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:215945:x1876834915921280:12345-0@lo:502:llog_process_th.0 Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.735580:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:1.0:1789892557.735593:0:215945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215945:1876834915921280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892557.735620:0:215945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:2.0:1789892557.735705:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:2.0:1789892557.735718:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892557.735723:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.735730:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.735736:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892557.735743:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892557.735745:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892557.735758:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.735764:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.735769:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.735779:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.735808:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.735829:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.735874:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921408 00000100:00100000:0.0:1789892557.735880:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921408 00000100:00100000:0.0:1789892557.735915:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:0.0:1789892557.735921:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915921408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892557.735928:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892557.735935:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021367d expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.735976:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 19 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.735983:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 19 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.735988:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837e00, rc 0) 00000100:00100000:0.0:1789892557.736029:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915921408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.736035:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:2.0:1789892557.736060:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.736069:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.736074:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.736101:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.736120:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.736134:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.736157:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921536 00000100:00100000:3.0:1789892557.736162:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921536 00000100:00100000:3.0:1789892557.736182:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:3.0:1789892557.736187:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915921536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.736244:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915921536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.736250:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00100000:2.0:1789892557.736269:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.736290:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.736317:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.736335:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.736351:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921664 00000100:00100000:0.0:1789892557.736355:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921664 00000100:00100000:0.0:1789892557.736378:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:0.0:1789892557.736383:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915921664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.736449:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915921664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.736461:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.736465:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000040:00080000:0.0:1789892557.737041:0:215946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789892557.737100:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789892557.737118:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892557.737122:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.737128:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.737133:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892557.737135:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 174 10000000:01000000:2.0:1789892557.737137:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892557.737147:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.737155:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.737163:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.737176:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.737204:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.737224:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.737249:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921792 00000100:00100000:3.0:1789892557.737254:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921792 00000100:00100000:3.0:1789892557.737280:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:3.0:1789892557.737293:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915921792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892557.737301:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892557.737308:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021368b expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.737320:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 20 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.737326:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 20 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.737331:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e200, rc 0) 00000100:00100000:3.0:1789892557.737362:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915921792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.737367:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000100:00100000:2.0:1789892557.737392:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.737401:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.737416:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.737443:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.737462:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.737475:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.737508:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915921920 00000100:00100000:0.0:1789892557.737512:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915921920 00000100:00100000:0.0:1789892557.737541:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:0.0:1789892557.737546:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915921920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.737603:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915921920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.737609:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:2.0:1789892557.737623:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915921920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.737641:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.737667:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.737686:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.737699:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922048 00000100:00100000:3.0:1789892557.737704:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922048 00000100:00100000:3.0:1789892557.737725:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:3.0:1789892557.737730:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915922048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.737791:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915922048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.737797:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00100000:2.0:1789892557.737807:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892557.737978:0:215947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215947:1876834915922176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.738018:0:215947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.738034:0:215947:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.738060:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922176 00000100:00100000:0.0:1789892557.738065:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922176 00000100:00100000:0.0:1789892557.738091:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:0.0:1789892557.738098:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215947:x1876834915922176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.738167:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215947:x1876834915922176:12345-0@lo:502:llog_process_th.0 Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892557.738174:0:215947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215947:1876834915922176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.738175:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00100000:1.0:1789892557.738213:0:215947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215947:1876834915922304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.738245:0:215947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.738258:0:215947:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.738313:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922304 00000100:00100000:3.0:1789892557.738318:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922304 00000100:00100000:3.0:1789892557.738353:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230 00000100:00100000:3.0:1789892557.738359:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215947:x1876834915922304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.738427:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:215947:x1876834915922304:12345-0@lo:502:llog_process_th.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892557.738433:0:215947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215947:1876834915922304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.738447:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230 00000040:00080000:1.0:1789892557.738458:0:215947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:2.0:1789892557.738553:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:2.0:1789892557.738567:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892557.738572:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.738579:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.738585:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892557.738586:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 200 10000000:01000000:2.0:1789892557.738588:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892557.738600:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.738606:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.738618:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.738628:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.738652:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.738675:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.738682:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922432 00000100:00100000:0.0:1789892557.738686:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922432 00000100:00100000:0.0:1789892557.738710:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:0.0:1789892557.738717:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915922432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892557.738723:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892557.738730:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213699 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.738743:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 21 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.738758:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 21 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.738763:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837400, rc 0) 00000100:00100000:0.0:1789892557.738792:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915922432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.738797:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:2.0:1789892557.738813:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.738823:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.738829:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.738855:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.738873:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.738885:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.738956:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922560 00000100:00100000:3.0:1789892557.738962:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922560 00000100:00100000:3.0:1789892557.738989:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:3.0:1789892557.738995:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915922560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.739059:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915922560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.739076:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00100000:2.0:1789892557.739085:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.739108:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.739135:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.739151:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.739166:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922688 00000100:00100000:0.0:1789892557.739170:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922688 00000100:00100000:0.0:1789892557.739191:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:0.0:1789892557.739196:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915922688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.739253:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915922688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.739259:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:2.0:1789892557.739277:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915922688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.739538:0:215948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215948:1876834915922816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.739580:0:215948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892557.739612:0:215948:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699156fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.739617:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922816 00000100:00100000:3.0:1789892557.739622:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922816 00000100:00100000:3.0:1789892557.739646:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234 00000100:00100000:3.0:1789892557.739651:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215948:x1876834915922816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.739722:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215948:x1876834915922816:12345-0@lo:502:llog_process_th.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.739728:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234 00000100:00100000:0.0:1789892557.739752:0:215948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215948:1876834915922816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892557.739774:0:215948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892557.739783:0:215948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892557.739785:0:215948:0:(obd_config.c:1561:class_process_config()) marker 190 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:0.0:1789892557.739789:0:215948:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789892557.739802:0:215948:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:0.0:1789892557.739815:0:215948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215948:1876834915922944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.739843:0:215948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892557.739864:0:215948:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699156fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892557.739882:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915922944 00000100:00100000:2.0:1789892557.739887:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915922944 00000100:00100000:2.0:1789892557.739910:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235 00000100:00100000:2.0:1789892557.739915:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215948:x1876834915922944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892557.740001:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:215948:x1876834915922944:12345-0@lo:502:llog_process_th.0 Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.740006:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235 00000100:00100000:0.0:1789892557.740046:0:215948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215948:1876834915922944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892557.740064:0:215948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892557.740079:0:215948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892557.740080:0:215948:0:(obd_config.c:1561:class_process_config()) marker 190 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789892557.740083:0:215948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 203 count 199 00000020:01000000:2.0:1789892557.740122:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 200-202 (rc=0) 10000000:01000000:2.0:1789892557.740141:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892557.740146:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.740154:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.740162:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892557.740164:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 174 10000000:01000000:2.0:1789892557.740166:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892557.740181:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.740189:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.740198:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.740211:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.740231:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.740245:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.740303:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923072 00000100:00100000:3.0:1789892557.740309:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923072 00000100:00100000:3.0:1789892557.740335:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:3.0:1789892557.740349:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915923072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892557.740356:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892557.740363:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002136a7 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.740376:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 22 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.740382:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 22 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.740393:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f200, rc 0) 00000100:00100000:3.0:1789892557.740425:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915923072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.740430:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:2.0:1789892557.740452:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.740462:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.740474:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.740526:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.740544:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.740563:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.740574:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923200 00000100:00100000:0.0:1789892557.740580:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923200 00000100:00100000:0.0:1789892557.740608:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1789892557.740618:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915923200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.740691:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915923200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.740699:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:2.0:1789892557.740706:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.740726:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.740752:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.740766:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.740830:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923328 00000100:00100000:3.0:1789892557.740835:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923328 00000100:00100000:3.0:1789892557.740861:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:3.0:1789892557.740868:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915923328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.740933:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915923328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.740940:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:2.0:1789892557.740964:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892557.741165:0:215949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215949:1876834915923456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.741196:0:215949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.741210:0:215949:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.741227:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923456 00000100:00100000:0.0:1789892557.741232:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923456 00000100:00100000:0.0:1789892557.741254:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:0.0:1789892557.741260:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215949:x1876834915923456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.741324:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215949:x1876834915923456:12345-0@lo:502:llog_process_th.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.741330:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:1.0:1789892557.741343:0:215949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215949:1876834915923456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.741373:0:215949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215949:1876834915923584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892557.741399:0:215949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892557.741412:0:215949:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688ea5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.741470:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923584 00000100:00100000:3.0:1789892557.741475:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923584 00000100:00100000:3.0:1789892557.741526:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:3.0:1789892557.741534:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215949:x1876834915923584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.741605:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:215949:x1876834915923584:12345-0@lo:502:llog_process_th.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.741611:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00100000:1.0:1789892557.741626:0:215949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215949:1876834915923584:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892557.741648:0:215949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:2.0:1789892557.741694:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:2.0:1789892557.741709:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892557.741714:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.741720:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.741725:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892557.741726:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 200 10000000:01000000:2.0:1789892557.741728:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892557.741738:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.741743:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.741754:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.741763:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.741790:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.741809:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699024f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.741827:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923712 00000100:00100000:0.0:1789892557.741839:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923712 00000100:00100000:0.0:1789892557.741861:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:0.0:1789892557.741865:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915923712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892557.741871:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892557.741879:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002136b5 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.741899:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.741906:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892557.741911:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837800, rc 0) 00000100:00100000:0.0:1789892557.741958:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915923712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.741973:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00100000:2.0:1789892557.741976:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.741989:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.741996:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.742021:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.742039:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.742053:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699024f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.742079:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923840 00000100:00100000:3.0:1789892557.742083:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923840 00000100:00100000:3.0:1789892557.742104:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:3.0:1789892557.742108:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915923840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892557.742175:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915923840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.742183:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1789892557.742194:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.742220:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.742246:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.742259:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699024f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.742277:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915923968 00000100:00100000:0.0:1789892557.742281:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915923968 00000100:00100000:0.0:1789892557.742301:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:0.0:1789892557.742305:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915923968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.742370:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915923968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892557.742377:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1789892557.742390:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915923968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.742593:0:215950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215950:1876834915924096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892557.742642:0:215950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892557.742672:0:215950:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e9323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.742678:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915924096 00000100:00100000:3.0:1789892557.742682:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915924096 00000100:00100000:3.0:1789892557.742705:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:3.0:1789892557.742711:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215950:x1876834915924096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892557.742782:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215950:x1876834915924096:12345-0@lo:502:llog_process_th.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.742788:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:0.0:1789892557.742807:0:215950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215950:1876834915924096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892557.742828:0:215950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892557.742834:0:215950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892557.742835:0:215950:0:(obd_config.c:1561:class_process_config()) marker 189 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:0.0:1789892557.742839:0:215950:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789892557.742845:0:215950:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000020:01000004:0.0:1789892557.743114:0:215951:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000100:00100000:3.0:1789892557.743119:0:215950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215950:1876834915924224:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789892557.743120:0:215951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:3.0:1789892557.743157:0:215950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892557.743175:0:215950:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688aa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892557.743201:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915924224 00000100:00100000:2.0:1789892557.743205:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915924224 00000100:00100000:2.0:1789892557.743233:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:2.0:1789892557.743240:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215950:x1876834915924224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892557.743314:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:215950:x1876834915924224:12345-0@lo:502:llog_process_th.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892557.743320:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:3.0:1789892557.743353:0:215950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:215950:1876834915924224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892557.743373:0:215950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892557.743377:0:215950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892557.743378:0:215950:0:(obd_config.c:1561:class_process_config()) marker 189 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892557.743381:0:215950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 203 count 199 00000020:01000000:2.0:1789892557.743424:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 200-202 (rc=0) 10000000:01000000:2.0:1789892557.743444:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892557.743449:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.743456:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892557.743462:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892557.743463:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892557.743465:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892557.743475:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.743480:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.743485:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.743511:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915924352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.743537:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892557.743562:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915924352 00000100:00100000:3.0:1789892557.743566:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915924352 00000100:00100000:2.0:1789892557.743578:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699024f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892557.743604:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:3.0:1789892557.743618:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915924352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892557.743629:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892557.743637:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002136c3 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.743649:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 24 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.743656:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 24 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892557.743667:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ec00, rc 0) 00000100:00100000:3.0:1789892557.743696:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915924352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892557.743703:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:2.0:1789892557.743712:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915924352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892557.743724:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.743736:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892557.743763:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915924480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892557.743783:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892557.743796:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90699024f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892557.743807:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915924480 00000100:00100000:0.0:1789892557.743816:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915924480 00000100:00100000:0.0:1789892557.743839:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:0.0:1789892557.743843:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915924480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892557.743890:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915924480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (106us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892557.743897:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:2.0:1789892557.743909:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915924480:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892557.743928:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892557.743932:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892557.743937:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892558.287624:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892558.287681:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925855872 00000100:00100000:3.0:1789892558.287690:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925855872 00000100:00100000:3.0:1789892558.287740:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2248 00000100:00100000:3.0:1789892558.287748:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925855872:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892558.287761:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892558.287777:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a645 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892558.287801:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892558.287818:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892558.287829:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e600, rc 0) 00000100:00100000:3.0:1789892558.287885:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925855872:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 136us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892558.287893:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2248 00000100:00100000:0.0:1789892558.288781:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892558.288833:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856000 00000100:00100000:2.0:1789892558.288837:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856000 00000100:00100000:2.0:1789892558.288863:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2249 00000100:00100000:2.0:1789892558.288869:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925856000:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892558.289001:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925856000:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892558.289007:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2249 00000100:00100000:1.0:1789892558.289658:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892558.289694:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856128 00000100:00100000:3.0:1789892558.289699:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856128 00000100:00100000:3.0:1789892558.289721:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2250 00000100:00100000:3.0:1789892558.289727:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925856128:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892558.289833:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925856128:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892558.289843:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2250 00000100:00100000:3.0:1789892558.290738:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892558.290787:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856256 00000100:00100000:2.0:1789892558.290792:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856256 00000100:00100000:2.0:1789892558.290836:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2251 00000100:00100000:2.0:1789892558.290855:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214670:x1876834925856256:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892558.290963:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214670:x1876834925856256:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 110us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892558.290973:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2251 00000100:00100000:0.0:1789892558.291587:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892558.291631:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856384 00000100:00100000:3.0:1789892558.291636:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856384 00000100:00100000:3.0:1789892558.291666:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2252 00000100:00100000:3.0:1789892558.291672:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214670:x1876834925856384:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892558.291734:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214670:x1876834925856384:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892558.291739:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2252 00000100:00100000:1.0:1789892558.292587:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892558.292624:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856512 00000100:00100000:2.0:1789892558.292630:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856512 00000100:00100000:2.0:1789892558.292655:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2253 00000100:00100000:2.0:1789892558.292661:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925856512:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892558.292669:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892558.292677:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a64c expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892558.292690:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892558.292697:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892558.292703:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff800, rc 0) 00000100:00100000:2.0:1789892558.292729:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925856512:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892558.292734:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2253 00000100:00100000:2.0:1789892558.293407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892558.293433:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856640 00000100:00100000:3.0:1789892558.293438:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856640 00000100:00100000:3.0:1789892558.293461:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2254 00000100:00100000:3.0:1789892558.293470:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925856640:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892558.293564:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925856640:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 94us (155us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892558.293574:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2254 00010000:00010000:0.0:1789892558.626688:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789892559.050019:0:215999:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd7296be20 20000000:00000080:3.0:1789892559.050037:0:215999:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90688b354000 uarg=0000000000000000 00000040:00100000:3.0:1789892559.050729:0:215999:0:(llog.c:1072:llog_reverse_process()) index 176 : idx 137 20000000:01000000:3.0:1789892559.050755:0:215999:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 166 cmd:0xce021 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:3.0:1789892559.050779:0:215999:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1789892559.051135:0:216000:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 179 1->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:3.0:1789892559.051203:0:216000:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 167 marker 179 2->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892559.051243:0:216000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000040:00080000:0.0:1789892559.051599:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].177, 224 off40584 20000000:01000000:0.0:1789892559.051625:0:215999:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892559.051645:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].178, 128 off40712 00000040:00080000:0.0:1789892559.051662:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].179, 224 off40936 20000000:01000000:0.0:1789892559.051677:0:215999:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789892559.052076:0:216001:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 191 marker 180 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:0.0:1789892559.052096:0:216001:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 193 marker 180 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789892559.052116:0:216001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 203 count 199 00000040:00080000:3.0:1789892559.052278:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].203, 224 off45400 20000000:01000000:3.0:1789892559.052291:0:215999:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789892559.052303:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].204, 136 off45536 00000040:00080000:3.0:1789892559.052315:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].205, 224 off45760 20000000:01000000:3.0:1789892559.052327:0:215999:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1789892559.052661:0:216002:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 191 marker 181 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:3.0:1789892559.052681:0:216002:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 193 marker 181 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892559.052693:0:216002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 203 count 199 00000040:00080000:0.0:1789892559.052847:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].203, 224 off45400 20000000:01000000:0.0:1789892559.052858:0:215999:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892559.052869:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].204, 136 off45536 00000040:00080000:0.0:1789892559.052880:0:215999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].205, 224 off45760 10000000:01000000:0.0:1789892559.052890:0:215999:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892559.052907:0:215999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052943:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052970:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052976:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052981:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052986:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052991:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.052995:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053000:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053005:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053012:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053028:0:215999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053042:0:215999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053077:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053089:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 9 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.053102:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924608:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892559.053200:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053208:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 9 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.053235:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924736:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892559.053274:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053301:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 23 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.053310:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924864:0@lo:104: 00000100:00100000:0.0:1789892559.053352:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892559.053406:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053429:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 23 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.053433:0:189422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789892559.053441:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924992:0@lo:104: 00000100:00100000:3.0:1789892559.053475:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915924864 00000100:00100000:3.0:1789892559.053485:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915924864 00000100:00100000:0.0:1789892559.053557:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892559.053601:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.053608:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915924992 00010000:00010000:0.0:1789892559.053610:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 23 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.053617:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915924992 00000100:00100000:0.0:1789892559.053630:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925120:0@lo:104: 00000100:00100000:0.0:1789892559.053660:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.053689:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925120 00000100:00100000:1.0:1789892559.053695:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925120 00010000:00010000:0.0:1789892559.053726:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053740:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 23 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.053764:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925248:0@lo:104: 00000100:00100000:2.0:1789892559.053771:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789892559.053785:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789892559.053794:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215999:x1876834915924992:12345-0@lo:104: 00000100:00100000:0.0:1789892559.053795:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.053807:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215999:x1876834915925120:12345-0@lo:104: 00010000:00010000:2.0:1789892559.053816:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.053827:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053828:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.053884:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 23 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.053896:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925248 00000100:00100000:0.0:1789892559.053898:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925376:0@lo:104: 00000100:00100000:3.0:1789892559.053903:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925248 00010000:00010000:2.0:1789892559.053936:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892559.053944:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+6:215999:x1876834915924992:12345-0@lo:104: Request processed in 161us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.053981:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789892559.053998:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.054015:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925376 00000100:00100000:2.0:1789892559.054024:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925376 00010000:00010000:1.0:1789892559.054033:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892559.054043:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+6:215999:x1876834915925120:12345-0@lo:104: Request processed in 244us (380us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892559.054046:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.054061:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1789892559.054075:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00010000:00010000:0.0:1789892559.054077:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 23 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.054085:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688886c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+6:215999:x1876834915924864:12345-0@lo:104: 00010000:00010000:2.0:1789892559.054104:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.054112:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925504:0@lo:104: 00000100:00100000:3.0:1789892559.054116:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789892559.054138:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789892559.054144:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215999:x1876834915925376:12345-0@lo:104: 00000100:00100000:1.0:1789892559.054181:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215999:x1876834915925248:12345-0@lo:104: 00010000:00010000:3.0:1789892559.054184:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.054196:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.054212:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892559.054224:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789892559.054243:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688886c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:215999:x1876834915924864:12345-0@lo:104: Request processed in 159us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.054255:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00010000:00010000:0.0:1789892559.054275:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.054293:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 23 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.054299:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789892559.054306:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925632:0@lo:104: 00000100:00100000:3.0:1789892559.054312:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215999:x1876834915925376:12345-0@lo:104: Request processed in 170us (310us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892559.054312:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789892559.054327:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215999:x1876834915925248:12345-0@lo:104: Request processed in 173us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.054328:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789892559.054344:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1789892559.054351:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925504 00000100:00100000:2.0:1789892559.054361:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925504 00000100:00100000:0.0:1789892559.054362:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.054385:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925632 00000100:00100000:1.0:1789892559.054392:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925632 00010000:00010000:3.0:1789892559.054398:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789892559.054409:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.054423:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00010000:00010000:3.0:1789892559.054424:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffc00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892559.054425:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892559.054432:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.054451:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00010000:00010000:3.0:1789892559.054452:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.054469:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215999:x1876834915925504:12345-0@lo:104: 00010000:00010000:0.0:1789892559.054470:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 23 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892559.054473:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.054477:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215999:x1876834915925632:12345-0@lo:104: 00010000:00010000:1.0:1789892559.054506:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892559.054516:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892559.054527:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.054565:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925760:0@lo:104: 00010000:00010000:2.0:1789892559.054568:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789892559.054578:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:215999:x1876834915925504:12345-0@lo:104: Request processed in 138us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.054590:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00010000:00010000:1.0:1789892559.054618:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789892559.054620:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.054626:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:1.0:1789892559.054633:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215999:x1876834915925632:12345-0@lo:104: Request processed in 154us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.054641:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892559.054649:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.054671:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892559.054682:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00010000:00010000:0.0:1789892559.054700:0:215999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.054707:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffa00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892559.054719:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.054723:0:215999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 23 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.054728:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.054739:0:193632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789892559.054767:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.054783:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925760 00000100:00100000:1.0:1789892559.054796:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925760 10000000:00010000:2.0:1789892559.054812:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.054829:0:215999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915926016:0@lo:104: 10000000:01000000:2.0:1789892559.054833:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892559.054853:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789892559.054877:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215999:x1876834915925760:12345-0@lo:104: 00010000:00010000:2.0:1789892559.054888:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.054893:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.054898:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd002136b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136bc expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.054900:0:215999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.054939:0:215999:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e9320c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789892559.054948:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892559.054971:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1789892559.054977:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924864:0@lo:104: 00010000:00010000:3.0:1789892559.054978:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.054987:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.054996:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789892559.055013:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924992:0@lo:104: 00010000:00010000:3.0:1789892559.055029:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe600 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892559.055041:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.055043:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215999:x1876834915925760:12345-0@lo:104: Request processed in 172us (409us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892559.055047:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd002136a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ae expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.055078:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925120:0@lo:104: 00010000:00010000:3.0:1789892559.055087:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.055107:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1789892559.055110:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925248:0@lo:104: 10000000:00010000:3.0:1789892559.055133:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892559.055147:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892559.055147:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1789892559.055148:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925376:0@lo:104: 00010000:00010000:2.0:1789892559.055168:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.055168:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926016 00000100:00100000:1.0:1789892559.055179:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926016 00000100:00100000:0.0:1789892559.055187:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925504:0@lo:104: 00000100:00100000:0.0:1789892559.055213:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925632:0@lo:104: 00000100:00100000:1.0:1789892559.055214:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00010000:00010000:2.0:1789892559.055235:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffee00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892559.055242:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215999:x1876834915926016:12345-0@lo:104: 00000100:00100000:0.0:1789892559.055245:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915925760:0@lo:104: 00010000:00010000:3.0:1789892559.055248:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892559.055249:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055265:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055284:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892559.055305:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055314:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd002136c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ca expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055327:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789892559.055344:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055379:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892559.055391:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055392:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055395:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffec00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892559.055404:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:0.0:1789892559.055410:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.055422:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:215999:x1876834915926016:12345-0@lo:104: Request processed in 188us (528us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892559.055437:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffe00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892559.055447:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.055455:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 10000000:00010000:2.0:1789892559.055466:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055479:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892559.055485:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055490:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055490:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.055495:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892559.055549:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffea00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892559.055560:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892559.055565:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892559.055566:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055571:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.055580:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892559.055586:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789892559.055607:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055624:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.055624:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892559.055647:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892559.055652:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892559.055673:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789892559.055716:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892559.055722:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.055723:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd0021368b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213692 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055729:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055744:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055773:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892559.055787:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892559.055790:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055791:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd0021367d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213684 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055792:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892559.055793:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055836:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892559.055836:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055847:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd0021366f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213676 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.055865:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff000 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892559.055866:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055884:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136a0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892559.055896:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055899:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892559.055911:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.055981:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.055982:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892559.055984:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892559.055989:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892559.055990:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.055991:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892559.055997:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892559.056001:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789892559.056015:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892559.056018:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892559.056022:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892559.056024:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915926272:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789892559.056046:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892559.056053:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915926016:0@lo:104: 00010000:00010000:3.0:1789892559.056059:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.056067:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892559.056077:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.056082:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.056085:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021365a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.056107:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892559.056107:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915926400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892559.056109:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892559.056130:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.056150:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213668 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.056173:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892559.056184:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892559.056194:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892559.056201:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892559.056208:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892559.056208:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892559.056221:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892559.056229:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915926784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892559.056255:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915926144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892559.056262:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915926912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892559.056278:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.056331:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.056356:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915925888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892559.056363:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926272 00000100:00100000:1.0:1789892559.056367:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926272 00010000:00010000:1.0:1789892559.056412:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 24 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.056438:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915926656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892559.056448:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.056449:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926400 00000100:00100000:1.0:1789892559.056456:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926400 00010000:00010000:1.0:1789892559.056481:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 25 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.056483:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926784 00000100:00100000:2.0:1789892559.056506:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892559.056529:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926784 00000100:00100000:1.0:1789892559.056554:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926144 00000100:00100000:1.0:1789892559.056560:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926144 00010000:00010000:3.0:1789892559.056563:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 26 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.056587:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 27 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.056596:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915926528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892559.056601:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915925888 00000100:00100000:3.0:1789892559.056609:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915925888 00000100:00100000:1.0:1789892559.056622:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926656 00000100:00100000:1.0:1789892559.056626:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926656 00000100:00100000:2.0:1789892559.056635:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00010000:00010000:3.0:1789892559.056640:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 29 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.056656:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892559.056660:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 29 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.056665:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3620:x1876834915926272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892559.056687:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926528 00000100:00100000:3.0:1789892559.056694:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926528 00000100:00100000:0.0:1789892559.056698:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915927040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892559.056701:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892559.056717:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00010000:00010000:3.0:1789892559.056720:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 30 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.056720:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 30 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.056738:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3621:x1876834915926400:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892559.056741:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892559.056782:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892559.056790:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927040 00010000:00010000:2.0:1789892559.056790:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 30 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.056796:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 30 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.056801:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927040 00010000:00010000:3.0:1789892559.056834:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 31 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.056842:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892559.056875:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00010000:00010000:1.0:1789892559.056879:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 31 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.056888:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3620:x1876834915926784:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892559.056899:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924608:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892559.056901:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892559.056903:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ec00/0x5c4f93dd002136ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002136c3 expref: 31 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.056912:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e200/0x5c4f93dd00213692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021368b expref: 31 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.056938:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 31 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.056951:0:215999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215999:1876834915924736:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892559.057007:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892559.057014:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 29 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.057035:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892559.057049:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837400/0x5c4f93dd002136a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213699 expref: 29 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.057071:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892559.057104:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3621:x1876834915926400:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892559.057116:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1789892559.057157:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915926272:12345-0@lo:103:ldlm_bl.0 Request processed in 501us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.057158:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915926784:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (880us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892559.057167:0:215999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.057171:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789892559.057194:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3619:x1876834915926144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892559.057198:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:1.0:1789892559.057218:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892559.057219:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00010000:00010000:1.0:1789892559.057228:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 26 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.057243:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 25 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.057286:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f200/0x5c4f93dd002136ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002136a7 expref: 25 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.057291:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1789892559.057310:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00010000:00010000:1.0:1789892559.057313:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892559.057318:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915925888:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892559.057329:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00010000:00010000:3.0:1789892559.057333:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892559.057342:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915926656:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892559.057344:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915926528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892559.057347:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 24 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.057369:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915926144:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (1039us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892559.057375:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892559.057376:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892559.057379:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 24 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.057394:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 24 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.057396:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 24 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.057442:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00010000:00010000:3.0:1789892559.057473:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837800/0x5c4f93dd002136bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002136b5 expref: 23 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.057485:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00010000:00010000:0.0:1789892559.057486:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 23 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.057496:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3622:x1876834915927040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892559.057550:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892559.057560:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 22 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.057561:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 22 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.057603:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892559.057616:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 22 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.057618:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e000/0x5c4f93dd00213676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021366f expref: 22 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.057656:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3622:x1876834915925888:12345-0@lo:103:ldlm_bl.0 Request processed in 346us (1207us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892559.057672:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837e00/0x5c4f93dd00213684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021367d expref: 21 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.057674:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:0.0:1789892559.057678:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892559.057681:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd00213668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213661 expref: 21 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.057738:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892559.057744:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892559.057777:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915925888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892559.057790:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3619:x1876834915926656:12345-0@lo:103:ldlm_bl.0 Request processed in 440us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.057810:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1789892559.057818:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915927040:12345-0@lo:103:ldlm_bl.0 Request processed in 319us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.057828:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915927040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892559.057843:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1789892559.057857:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915926528:12345-0@lo:103:ldlm_bl.0 Request processed in 513us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.057865:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1789892559.057876:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915926528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892559.057945:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892559.057948:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915926272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892559.057997:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915926144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892559.058009:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915926784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892559.058017:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.058037:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915926656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892559.058064:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892559.058100:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856896 00000100:00100000:1.0:1789892559.058106:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856896 00000100:00100000:3.0:1789892559.058114:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915926912 00000100:00100000:3.0:1789892559.058120:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915926912 00010000:00010000:1.0:1789892559.058133:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 10 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.058134:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915926400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892559.058144:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 16 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892559.058207:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925856768 00000100:00100000:1.0:1789892559.058213:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925856768 00000100:00100000:3.0:1789892559.058218:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 536 00000100:00100000:2.0:1789892559.058233:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00010000:00010000:1.0:1789892559.058236:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 11 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.058239:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925856896:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892559.058250:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892559.058259:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915926912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892559.058260:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 11 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.058271:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 11 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.058294:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 538 00010000:00010000:2.0:1789892559.058297:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892559.058298:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff800/0x5c4f93dd002136d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a64c expref: 11 pid: 189434 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.058314:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 16 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.058317:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892559.058317:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925856768:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892559.058337:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 16 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058338:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892559.058355:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f800/0x5c4f93dd0021365a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213653 expref: 16 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058356:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 10 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892559.058376:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925856896:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 143us (433us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892559.058384:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892559.058400:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 536 00010000:00010000:0.0:1789892559.058409:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 10 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058452:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e600/0x5c4f93dd002136d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a645 expref: 9 pid: 189432 timeout: 3484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058471:0:189424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.058473:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3621:x1876834915926912:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (467us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892559.058487:0:189424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.058491:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00010000:00010000:0.0:1789892559.058549:0:189424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058563:0:189424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058569:0:189424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058575:0:189424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058580:0:189424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837c00 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:0.0:1789892559.058586:0:189424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058592:0:189424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.058613:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915926912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892559.058623:0:189424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.058640:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892559.058681:0:215999:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.058683:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925856768:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 376us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.058711:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 538 00010000:00010000:1.0:1789892559.058733:0:215999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.058757:0:215999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd002136df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.538577:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892559.538583:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 177 10000000:01000000:2.0:1789892559.538587:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892559.538632:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.538642:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.538650:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.538671:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.538731:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.538790:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069b2488600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.538805:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927168 00000100:00100000:0.0:1789892559.538814:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927168 00000100:00100000:0.0:1789892559.538869:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255 00000100:00100000:0.0:1789892559.538880:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915927168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892559.538895:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892559.538934:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002136e6 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.538967:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.538979:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.538989:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837000, rc 0) 00000100:00100000:0.0:1789892559.539046:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915927168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.539056:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255 00000100:00100000:2.0:1789892559.539075:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.539109:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.539120:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.539192:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.539211:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.539249:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069b2488600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.539309:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927296 00000100:00100000:3.0:1789892559.539321:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927296 00000100:00100000:3.0:1789892559.539370:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:3.0:1789892559.539377:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915927296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.539618:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915927296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.539637:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00100000:2.0:1789892559.539765:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.539820:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.539859:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.539881:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069b2488600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.539928:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927424 00000100:00100000:0.0:1789892559.539935:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927424 00000100:00100000:0.0:1789892559.539972:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1789892559.539987:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915927424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.540100:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915927424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.540109:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:2.0:1789892559.540128:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.540565:0:216003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216003:1876834915927552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892559.540603:0:216003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.540622:0:216003:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069b24883c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.540697:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927552 00000100:00100000:3.0:1789892559.540705:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927552 00000100:00100000:3.0:1789892559.540741:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00100000:3.0:1789892559.540748:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216003:x1876834915927552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.540944:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216003:x1876834915927552:12345-0@lo:502:llog_process_th.0 Request processed in 192us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.540952:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00100000:2.0:1789892559.540992:0:216003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216003:1876834915927552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892559.541049:0:216003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216003:1876834915927680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892559.541085:0:216003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.541102:0:216003:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.541160:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927680 00000100:00100000:0.0:1789892559.541167:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927680 00000100:00100000:0.0:1789892559.541201:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:0.0:1789892559.541225:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216003:x1876834915927680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.541341:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216003:x1876834915927680:12345-0@lo:502:llog_process_th.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.541350:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:2.0:1789892559.541386:0:216003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216003:1876834915927680:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892559.541422:0:216003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:0.0:1789892559.541538:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:0.0:1789892559.541564:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892559.541572:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.541583:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892559.541593:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892559.541595:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789892559.541598:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892559.541615:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.541622:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.541641:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.541655:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.541683:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.541709:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.541784:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927808 00000100:00100000:3.0:1789892559.541793:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927808 00000100:00100000:3.0:1789892559.541832:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1789892559.541840:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915927808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892559.541862:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892559.541880:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002136f4 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.541926:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.541939:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.541949:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f400, rc 0) 00000100:00100000:3.0:1789892559.542001:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915927808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.542008:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:0.0:1789892559.542066:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892559.542084:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.542095:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892559.542172:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.542204:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.542245:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892559.542262:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915927936 00000100:00100000:2.0:1789892559.542269:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915927936 00000100:00100000:2.0:1789892559.542304:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:2.0:1789892559.542310:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915927936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.542433:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915927936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.542440:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:0.0:1789892559.542482:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915927936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.542580:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.542633:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.542678:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.542748:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928064 00000100:00100000:3.0:1789892559.542764:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928064 00000100:00100000:3.0:1789892559.542824:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:3.0:1789892559.542837:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915928064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.542984:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915928064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.542992:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:0.0:1789892559.543045:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892559.544291:0:216004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:2.0:1789892559.544388:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892559.544434:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892559.544441:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.544451:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.544474:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892559.544475:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 177 10000000:01000000:2.0:1789892559.544477:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892559.544491:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.544496:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.544514:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.544576:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.544622:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.544651:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.544673:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928192 00000100:00100000:0.0:1789892559.544681:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928192 00000100:00100000:0.0:1789892559.544732:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:0.0:1789892559.544742:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915928192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892559.544754:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892559.544766:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213702 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.544789:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.544803:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.544813:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892559.544872:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915928192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.544881:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:2.0:1789892559.544893:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.544904:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.544923:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.544975:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.544999:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.545017:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.545099:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928320 00000100:00100000:3.0:1789892559.545109:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928320 00000100:00100000:3.0:1789892559.545162:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:3.0:1789892559.545170:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915928320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.545283:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915928320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.545293:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:2.0:1789892559.545313:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.545347:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.545390:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.545426:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.545454:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928448 00000100:00100000:0.0:1789892559.545462:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928448 00000100:00100000:0.0:1789892559.545537:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:0.0:1789892559.545564:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915928448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.545679:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915928448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.545691:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:2.0:1789892559.545704:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.546065:0:216005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216005:1876834915928576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.546117:0:216005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.546177:0:216005:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698303d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.546189:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928576 00000100:00100000:3.0:1789892559.546226:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928576 00000100:00100000:3.0:1789892559.546263:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:3.0:1789892559.546272:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216005:x1876834915928576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.546380:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216005:x1876834915928576:12345-0@lo:502:llog_process_th.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.546387:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:0.0:1789892559.546452:0:216005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216005:1876834915928576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.546595:0:216005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216005:1876834915928704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.546655:0:216005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.546703:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928704 00000100:00100000:0.0:1789892559.546705:0:216005:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698303d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892559.546711:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928704 00000100:00100000:2.0:1789892559.546748:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:2.0:1789892559.546756:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216005:x1876834915928704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892559.546860:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216005:x1876834915928704:12345-0@lo:502:llog_process_th.0 Request processed in 106us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.546866:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:0.0:1789892559.546895:0:216005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216005:1876834915928704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892559.546959:0:216005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:2.0:1789892559.547041:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:2.0:1789892559.547069:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892559.547074:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.547082:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.547088:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892559.547090:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892559.547092:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892559.547104:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.547111:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.547117:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.547127:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.547165:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.547178:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.547312:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928832 00000100:00100000:3.0:1789892559.547324:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928832 00000100:00100000:3.0:1789892559.547379:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:3.0:1789892559.547386:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915928832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892559.547395:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892559.547406:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213710 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.547433:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.547443:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.547450:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e800, rc 0) 00000100:00100000:3.0:1789892559.547535:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915928832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.547543:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00100000:2.0:1789892559.547599:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.547612:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.547619:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.547657:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.547693:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.547719:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.547763:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915928960 00000100:00100000:0.0:1789892559.547781:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915928960 00000100:00100000:0.0:1789892559.547842:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:0.0:1789892559.547851:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915928960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.547976:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915928960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.547989:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:2.0:1789892559.547998:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915928960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.548025:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.548058:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.548075:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.548115:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929088 00000100:00100000:3.0:1789892559.548124:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929088 00000100:00100000:3.0:1789892559.548176:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:3.0:1789892559.548185:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915929088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.548337:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915929088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.548348:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:2.0:1789892559.548357:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892559.549372:0:216006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789892559.549529:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789892559.549552:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892559.549575:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.549586:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.549597:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892559.549600:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 177 10000000:01000000:2.0:1789892559.549603:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892559.549619:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.549625:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.549632:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.549653:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.549704:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.549724:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.549745:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929216 00000100:00100000:0.0:1789892559.549751:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929216 00000100:00100000:0.0:1789892559.549784:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1789892559.549793:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915929216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892559.549803:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892559.549813:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021371e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.549855:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.549875:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.549889:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836800, rc 0) 00000100:00100000:0.0:1789892559.550022:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915929216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.550034:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:2.0:1789892559.550050:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.550063:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.550070:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.550102:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.550137:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.550171:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.550213:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929344 00000100:00100000:3.0:1789892559.550233:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929344 00000100:00100000:3.0:1789892559.550276:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:3.0:1789892559.550287:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915929344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.550382:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915929344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.550389:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:2.0:1789892559.550426:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.550459:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.550591:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.550625:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892559.550638:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929472 00000100:00100000:1.0:1789892559.550646:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929472 00000100:00100000:1.0:1789892559.550700:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:1.0:1789892559.550710:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915929472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892559.550820:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915929472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892559.550828:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:2.0:1789892559.550836:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892559.551181:0:216007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216007:1876834915929600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892559.551237:0:216007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.551257:0:216007:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.551308:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929600 00000100:00100000:3.0:1789892559.551319:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929600 00000100:00100000:3.0:1789892559.551383:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:3.0:1789892559.551391:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216007:x1876834915929600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.551560:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216007:x1876834915929600:12345-0@lo:502:llog_process_th.0 Request processed in 166us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.551571:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1789892559.551622:0:216007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216007:1876834915929600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892559.551681:0:216007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216007:1876834915929728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892559.551732:0:216007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.551760:0:216007:0:(client.c:2702:ptlrpc_set_wait()) set ffff906886f9cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.551791:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929728 00000100:00100000:0.0:1789892559.551801:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929728 00000100:00100000:0.0:1789892559.551858:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1789892559.551869:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216007:x1876834915929728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.552008:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216007:x1876834915929728:12345-0@lo:502:llog_process_th.0 Request processed in 139us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.552020:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1789892559.552030:0:216007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216007:1876834915929728:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892559.552066:0:216007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:2.0:1789892559.552123:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:2.0:1789892559.552160:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892559.552165:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.552171:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.552176:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892559.552183:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 203 10000000:01000000:2.0:1789892559.552185:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892559.552196:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.552201:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.552206:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.552231:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.552255:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.552273:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.552339:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929856 00000100:00100000:3.0:1789892559.552349:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929856 00000100:00100000:3.0:1789892559.552403:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:3.0:1789892559.552412:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915929856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892559.552425:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892559.552449:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021372c expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.552472:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.552486:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.552531:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e600, rc 0) 00000100:00100000:3.0:1789892559.552596:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915929856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.552607:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:2.0:1789892559.552634:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.552651:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.552661:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.552713:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.552741:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.552763:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.552781:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915929984 00000100:00100000:0.0:1789892559.552787:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915929984 00000100:00100000:0.0:1789892559.552819:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:0.0:1789892559.552826:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915929984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.552922:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915929984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.552930:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:2.0:1789892559.552933:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915929984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.552978:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.553008:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.553029:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.553075:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930112 00000100:00100000:3.0:1789892559.553084:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930112 00000100:00100000:3.0:1789892559.553124:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:3.0:1789892559.553150:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915930112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.553279:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915930112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.553296:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.553302:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:3.0:1789892559.553669:0:216008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216008:1876834915930240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.553721:0:216008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892559.553765:0:216008:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.553777:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930240 00000100:00100000:0.0:1789892559.553787:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930240 00000100:00100000:0.0:1789892559.553850:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1789892559.553858:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216008:x1876834915930240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.554038:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216008:x1876834915930240:12345-0@lo:502:llog_process_th.0 Request processed in 179us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.554049:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:3.0:1789892559.554099:0:216008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216008:1876834915930240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892559.554135:0:216008:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892559.554160:0:216008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892559.554164:0:216008:0:(obd_config.c:1561:class_process_config()) marker 193 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:3.0:1789892559.554171:0:216008:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892559.554196:0:216008:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000100:00100000:3.0:1789892559.554229:0:216008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216008:1876834915930368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.554281:0:216008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892559.554310:0:216008:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892559.554346:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930368 00000100:00100000:2.0:1789892559.554357:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930368 00000100:00100000:2.0:1789892559.554419:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:2.0:1789892559.554431:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216008:x1876834915930368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892559.554559:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216008:x1876834915930368:12345-0@lo:502:llog_process_th.0 Request processed in 129us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.554582:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:3.0:1789892559.554626:0:216008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216008:1876834915930368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892559.554656:0:216008:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892559.554663:0:216008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892559.554665:0:216008:0:(obd_config.c:1561:class_process_config()) marker 193 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892559.554670:0:216008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 206 count 202 00000020:01000000:2.0:1789892559.554761:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 203-205 (rc=0) 10000000:01000000:2.0:1789892559.554784:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892559.554791:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.554799:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.554806:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892559.554808:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 177 10000000:01000000:2.0:1789892559.554810:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892559.554846:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.554851:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.554856:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.554874:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.554895:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.554929:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.554946:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930496 00000100:00100000:0.0:1789892559.554968:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930496 00000100:00100000:0.0:1789892559.555006:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1789892559.555026:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915930496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892559.555037:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892559.555049:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021373a expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.555070:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.555083:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.555094:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836c00, rc 0) 00000100:00100000:0.0:1789892559.555156:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915930496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.555166:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1789892559.555178:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.555188:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.555195:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.555243:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.555265:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.555300:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.555335:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930624 00000100:00100000:3.0:1789892559.555343:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930624 00000100:00100000:3.0:1789892559.555395:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:3.0:1789892559.555409:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915930624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.555594:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915930624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.555617:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:2.0:1789892559.555628:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.555692:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.555740:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.555765:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.555795:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930752 00000100:00100000:0.0:1789892559.555805:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930752 00000100:00100000:0.0:1789892559.555859:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:0.0:1789892559.555867:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915930752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.555992:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915930752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.556000:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915930752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892559.556007:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:0.0:1789892559.556279:0:216009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216009:1876834915930880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.556338:0:216009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.556366:0:216009:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a408240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.556390:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915930880 00000100:00100000:3.0:1789892559.556398:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915930880 00000100:00100000:3.0:1789892559.556447:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:3.0:1789892559.556458:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216009:x1876834915930880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.556632:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216009:x1876834915930880:12345-0@lo:502:llog_process_th.0 Request processed in 175us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.556645:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:0.0:1789892559.556669:0:216009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216009:1876834915930880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.556736:0:216009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216009:1876834915931008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.556800:0:216009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892559.556850:0:216009:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a408240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892559.556885:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931008 00000100:00100000:1.0:1789892559.556891:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931008 00000100:00100000:1.0:1789892559.556940:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:1.0:1789892559.556966:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216009:x1876834915931008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892559.557066:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216009:x1876834915931008:12345-0@lo:502:llog_process_th.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892559.557073:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:0.0:1789892559.557113:0:216009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216009:1876834915931008:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892559.557154:0:216009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:2.0:1789892559.557226:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:2.0:1789892559.557244:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892559.557250:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.557257:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.557286:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892559.557287:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 203 10000000:01000000:2.0:1789892559.557290:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892559.557305:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.557312:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.557319:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.557330:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.557381:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.557406:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.557436:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931136 00000100:00100000:3.0:1789892559.557444:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931136 00000100:00100000:3.0:1789892559.557484:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:3.0:1789892559.557546:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915931136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892559.557558:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892559.557573:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213748 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.557607:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.557619:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892559.557635:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e000, rc 0) 00000100:00100000:3.0:1789892559.557692:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915931136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.557701:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1789892559.557714:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.557729:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.557737:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.557771:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.557797:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.557836:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892559.557847:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931264 00000100:00100000:1.0:1789892559.557852:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931264 00000100:00100000:1.0:1789892559.557878:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:1.0:1789892559.557884:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915931264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892559.558002:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915931264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.558013:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892559.558014:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:2.0:1789892559.558050:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.558080:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.558095:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.558127:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931392 00000100:00100000:3.0:1789892559.558136:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931392 00000100:00100000:3.0:1789892559.558185:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1789892559.558198:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915931392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.558338:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915931392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.558349:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:2.0:1789892559.558405:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892559.558736:0:216010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216010:1876834915931520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892559.558781:0:216010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892559.558810:0:216010:0:(client.c:2702:ptlrpc_set_wait()) set ffff906886f9cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.558857:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931520 00000100:00100000:0.0:1789892559.558863:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931520 00000100:00100000:0.0:1789892559.558902:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:0.0:1789892559.558926:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216010:x1876834915931520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892559.559064:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216010:x1876834915931520:12345-0@lo:502:llog_process_th.0 Request processed in 152us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.559075:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00100000:1.0:1789892559.559085:0:216010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216010:1876834915931520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892559.559112:0:216010:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892559.559121:0:216010:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892559.559123:0:216010:0:(obd_config.c:1561:class_process_config()) marker 192 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:1.0:1789892559.559128:0:216010:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789892559.559142:0:216010:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000020:01000004:1.0:1789892559.559637:0:216011:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892559.559641:0:216011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:3.0:1789892559.559666:0:216010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216010:1876834915931648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892559.559738:0:216010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892559.559789:0:216010:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892559.559797:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931648 00000100:00100000:2.0:1789892559.559821:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931648 00000100:00100000:2.0:1789892559.559854:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:2.0:1789892559.559861:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216010:x1876834915931648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892559.559980:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216010:x1876834915931648:12345-0@lo:502:llog_process_th.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.559986:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00100000:3.0:1789892559.560027:0:216010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882604700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216010:1876834915931648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892559.560061:0:216010:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892559.560068:0:216010:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892559.560070:0:216010:0:(obd_config.c:1561:class_process_config()) marker 192 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892559.560075:0:216010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 206 count 202 00000020:01000000:2.0:1789892559.560183:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 203-205 (rc=0) 10000000:01000000:2.0:1789892559.560223:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892559.560229:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.560236:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892559.560243:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892559.560244:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892559.560246:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892559.560263:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.560270:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.560305:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.560319:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.560369:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.560396:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892559.560428:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931776 00000100:00100000:0.0:1789892559.560436:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931776 00000100:00100000:0.0:1789892559.560474:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:0.0:1789892559.560485:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915931776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892559.560531:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892559.560541:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213756 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.560559:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.560586:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892559.560597:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836600, rc 0) 00000100:00100000:0.0:1789892559.560648:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915931776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892559.560666:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:2.0:1789892559.560678:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892559.560693:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.560701:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892559.560735:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892559.560759:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892559.560785:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688547c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892559.560815:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915931904 00000100:00100000:3.0:1789892559.560824:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915931904 00000100:00100000:3.0:1789892559.560875:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:3.0:1789892559.560883:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915931904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892559.561006:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915931904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (243us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892559.561019:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00100000:2.0:1789892559.561038:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915931904:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892559.561068:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892559.561073:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892559.561080:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892559.650807:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892559.760179:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892559.760277:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892559.760326:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857024 00000100:00100000:0.0:1789892559.760363:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857024 00000100:00100000:2.0:1789892559.760373:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857152 00000100:00100000:2.0:1789892559.760399:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857152 00000100:00080000:1.0:1789892559.760551:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789892559.760575:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892559.760588:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 488 00000100:00100000:2.0:1789892559.760610:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 489 00000100:00100000:3.0:1789892559.760639:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925857152:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892559.760654:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:2400:x1876834925857024:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1789892559.760816:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925857152:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 197us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892559.760817:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:2400:x1876834925857024:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 178us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892559.760850:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 488 00000100:00100000:2.0:1789892559.760874:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 489 00010000:00010000:2.0:1789892560.674744:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789892560.899282:0:216110:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc7e955e00 20000000:00000080:0.0:1789892560.899299:0:216110:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff906886fb2400 uarg=0000000000000000 00000040:00100000:0.0:1789892560.900085:0:216110:0:(llog.c:1072:llog_reverse_process()) index 179 : idx 137 20000000:01000000:0.0:1789892560.900094:0:216110:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 178 cmd:0xce022 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:0.0:1789892560.900114:0:216110:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool1 fl=4 20000000:01000000:0.0:1789892560.900656:0:216111:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 173 1->4: lustre-clilov new lustre.qpool1 20000000:01000000:0.0:1789892560.900705:0:216111:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 161 marker 173 2->4: lustre-clilov new lustre.qpool1 00000040:00080000:0.0:1789892560.900722:0:216111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000040:00080000:3.0:1789892560.901023:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].181, 224 off41184 20000000:01000000:3.0:1789892560.901054:0:216110:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:3.0:1789892560.901075:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].182, 104 off41288 00000040:00080000:3.0:1789892560.901095:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].183, 224 off41512 20000000:01000000:3.0:1789892560.901117:0:216110:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892560.901607:0:216112:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 185 marker 174 1->4: lustre-MDT0000-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892560.901638:0:216112:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 187 marker 174 2->4: lustre-MDT0000-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892560.901658:0:216112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 206 count 202 00000040:00080000:0.0:1789892560.901860:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].206, 224 off45984 20000000:01000000:0.0:1789892560.901878:0:216110:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892560.901918:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].207, 112 off46096 00000040:00080000:0.0:1789892560.901936:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].208, 224 off46320 20000000:01000000:0.0:1789892560.901951:0:216110:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:0.0:1789892560.902279:0:216113:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 185 marker 175 1->4: lustre-MDT0001-mdtlov new lustre.qpool1 20000000:01000000:0.0:1789892560.902301:0:216113:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 187 marker 175 2->4: lustre-MDT0001-mdtlov new lustre.qpool1 00000040:00080000:0.0:1789892560.902317:0:216113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 206 count 202 00000040:00080000:3.0:1789892560.902474:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].206, 224 off45984 20000000:01000000:3.0:1789892560.902542:0:216110:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:3.0:1789892560.902573:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].207, 112 off46096 00000040:00080000:3.0:1789892560.902605:0:216110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].208, 224 off46320 10000000:01000000:3.0:1789892560.902632:0:216110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789892560.902666:0:216110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902694:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902707:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902716:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902725:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902734:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902760:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902768:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902777:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902785:0:216110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902807:0:216110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902872:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.902932:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.902955:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932032:0@lo:104: 00000100:00100000:3.0:1789892560.903058:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892560.903159:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.903164:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932032 00010000:00010000:3.0:1789892560.903176:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 23 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.903184:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932032 00000100:00100000:3.0:1789892560.903211:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932160:0@lo:104: 00000100:00100000:3.0:1789892560.903256:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892560.903285:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932160 00000100:00100000:1.0:1789892560.903295:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932160 00000100:00100000:0.0:1789892560.903326:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00010000:00010000:3.0:1789892560.903335:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.903352:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932032:12345-0@lo:104: 00010000:00010000:3.0:1789892560.903356:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.903386:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00010000:00010000:0.0:1789892560.903387:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.903404:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932288:0@lo:104: 00000100:00100000:1.0:1789892560.903426:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932160:12345-0@lo:104: 00010000:00010000:1.0:1789892560.903456:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.903479:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892560.903566:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932288 00000100:00100000:2.0:1789892560.903593:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932288 00000100:00100000:2.0:1789892560.903689:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00010000:00010000:0.0:1789892560.903690:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892560.903697:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.903700:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892560.903721:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216110:x1876834915932032:12345-0@lo:104: Request processed in 371us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892560.903726:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216110:x1876834915932288:12345-0@lo:104: 00000100:00100000:1.0:1789892560.903731:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216110:x1876834915932160:12345-0@lo:104: Request processed in 314us (463us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892560.903776:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.903778:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 23 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.903808:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1789892560.903817:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932416:0@lo:104: 00000100:00100000:1.0:1789892560.903844:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00010000:00010000:0.0:1789892560.903917:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892560.903930:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892560.903946:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.903961:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892560.903967:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.903979:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.903987:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1789892560.903989:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.904001:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.904002:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789892560.904016:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216110:x1876834915932288:12345-0@lo:104: Request processed in 296us (531us total) trans 0 rc 0/0 10000000:01000000:0.0:1789892560.904018:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892560.904028:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.904075:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.904077:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.904083:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892560.904084:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 10000000:00010000:1.0:1789892560.904106:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.904140:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932544:0@lo:104: 00000100:00100000:2.0:1789892560.904148:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932416 00000100:00100000:2.0:1789892560.904165:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932416 00010000:00010000:0.0:1789892560.904180:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892560.904189:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.904217:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892560.904235:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.904241:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.904245:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932544 00000100:00100000:2.0:1789892560.904259:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932544 00010000:00010000:3.0:1789892560.904274:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.904303:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00010000:00010000:0.0:1789892560.904310:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021375d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892560.904312:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892560.904324:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688243b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932416:12345-0@lo:104: 00010000:00010000:2.0:1789892560.904374:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.904421:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 23 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.904435:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.904435:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892560.904460:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.904470:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932800:0@lo:104: 00010000:00010000:1.0:1789892560.904506:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892560.904520:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892560.904531:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.904537:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.904569:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021374f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.904573:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892560.904601:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688243b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932416:12345-0@lo:104: Request processed in 276us (670us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892560.904613:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.904623:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1789892560.904628:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789892560.904662:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892560.904672:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892560.904696:0:189472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892560.904698:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892560.904712:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.904713:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.904721:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932800 00010000:00010000:3.0:1789892560.904733:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.904736:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932800 00010000:00010000:0.0:1789892560.904748:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892560.904773:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00010000:00010000:1.0:1789892560.904783:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff600 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892560.904794:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.904796:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932544:12345-0@lo:104: 10000000:00010000:1.0:1789892560.904800:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.904800:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.904835:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.904852:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915933184:0@lo:104: 00010000:00010000:1.0:1789892560.904908:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.904909:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd0021373a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213741 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.904949:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892560.904972:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.904984:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892560.904987:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892560.904994:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892560.905001:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.905003:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1789892560.905024:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe400 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:3.0:1789892560.905028:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.905036:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892560.905039:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905041:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932544:12345-0@lo:104: Request processed in 234us (818us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892560.905092:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 23 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905117:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00010000:00010000:0.0:1789892560.905117:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.905120:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892560.905136:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915933312:0@lo:104: 00010000:00010000:1.0:1789892560.905153:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905162:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933184 00000100:00100000:2.0:1789892560.905177:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933184 00000100:00100000:3.0:1789892560.905204:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892560.905222:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 10000000:00010000:0.0:1789892560.905223:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.905242:0:216110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905259:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688a9fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932800:12345-0@lo:104: 10000000:01000000:0.0:1789892560.905284:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892560.905297:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd0021372c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213733 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.905299:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.905324:0:216110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.905341:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.905395:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892560.905401:0:216110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915933568:0@lo:104: 00010000:00010000:1.0:1789892560.905403:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892560.905406:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.905411:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892560.905419:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892560.905423:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892560.905445:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.905448:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd0021371e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213725 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905461:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688a9fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915932800:12345-0@lo:104: Request processed in 208us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892560.905541:0:216110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892560.905547:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffa00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892560.905559:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905574:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:0.0:1789892560.905579:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892560.905582:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.905591:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789892560.905602:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.905606:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892560.905617:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892560.905621:0:216110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892560.905638:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915932672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892560.905668:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.905679:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933312 00000100:00100000:3.0:1789892560.905680:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932032:0@lo:104: 00000100:00100000:2.0:1789892560.905690:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933312 00010000:00010000:1.0:1789892560.905696:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892560.905715:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892560.905717:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.905732:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213717 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.905737:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932160:0@lo:104: 00000100:00100000:2.0:1789892560.905739:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933568 00000100:00100000:2.0:1789892560.905761:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933568 00000100:00100000:0.0:1789892560.905764:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915933696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892560.905776:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932288:0@lo:104: 00000100:00100000:2.0:1789892560.905799:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1789892560.905812:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932416:0@lo:104: 00000100:00100000:2.0:1789892560.905832:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216110:x1876834915933184:12345-0@lo:104: 00000100:00100000:3.0:1789892560.905845:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932544:0@lo:104: 00010000:00010000:2.0:1789892560.905860:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.905864:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892560.905864:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892560.905877:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915932800:0@lo:104: 00010000:00010000:1.0:1789892560.905878:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892560.905908:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892560.905945:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915932928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892560.905980:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915933440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892560.906006:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892560.906040:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892560.906051:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789892560.906079:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216110:x1876834915933184:12345-0@lo:104: Request processed in 238us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892560.906083:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892560.906086:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216110:x1876834915933312:12345-0@lo:104: 00010000:00010000:3.0:1789892560.906120:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.906123:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932672 00000100:00100000:2.0:1789892560.906133:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1789892560.906141:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932672 00000100:00100000:1.0:1789892560.906164:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915933824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892560.906185:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789892560.906209:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915933568:12345-0@lo:104: 00010000:00010000:0.0:1789892560.906215:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 24 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.906230:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.906275:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892560.906276:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892560.906291:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216110:x1876834915933312:12345-0@lo:104: Request processed in 223us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.906304:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933696 00000100:00100000:3.0:1789892560.906309:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1789892560.906326:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933696 00010000:00010000:2.0:1789892560.906368:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789892560.906372:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 25 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.906395:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216110:x1876834915933568:12345-0@lo:104: Request processed in 184us (899us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892560.906402:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892560.906418:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.906426:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915933184:0@lo:104: 00000100:00100000:0.0:1789892560.906431:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915932928 00000100:00100000:2.0:1789892560.906432:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1789892560.906451:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915932928 00010000:00010000:1.0:1789892560.906472:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffee00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892560.906478:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915933312:0@lo:104: 10000000:00010000:1.0:1789892560.906480:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.906546:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 26 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.906551:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.906558:0:216110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216110:1876834915933568:0@lo:104: 00000100:00100000:2.0:1789892560.906566:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915933056:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789892560.906621:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892560.906632:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892560.906667:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933824 00000100:00100000:0.0:1789892560.906696:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933824 00000100:00100000:2.0:1789892560.906706:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892560.906724:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.906738:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 27 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.906740:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892560.906754:0:216110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.906773:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.906818:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffee00/0x5c4f93dd00213702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213709 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.906821:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933056 00000100:00100000:0.0:1789892560.906841:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933056 00000100:00100000:2.0:1789892560.906843:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915933952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892560.906848:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892560.906867:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892560.906871:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.906908:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.906916:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837600 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892560.906918:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 28 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892560.906953:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.906968:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892560.906989:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892560.907008:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.907012:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.907032:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933952 00010000:00010000:3.0:1789892560.907037:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.907040:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933952 00000100:00100000:2.0:1789892560.907055:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 10000000:00010000:1.0:1789892560.907061:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892560.907067:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.907074:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 29 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.907094:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3619:x1876834915932672:12345-0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789892560.907137:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892560.907153:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:1.0:1789892560.907161:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892560.907185:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 29 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.907212:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.907215:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00010000:00010000:2.0:1789892560.907217:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 29 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.907230:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.907261:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3619:x1876834915933696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892560.907279:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892560.907303:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836600/0x5c4f93dd0021375d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213756 expref: 29 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.907306:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892560.907308:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892560.907313:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.907337:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 29 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.907365:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892560.907377:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.907386:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd002136e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136ed expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.907403:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 28 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.907446:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+28:3619:x1876834915932672:12345-0@lo:103:ldlm_bl.0 Request processed in 352us (1723us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892560.907462:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892560.907467:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837600/0x5c4f93dd002136f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002136fb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.907471:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892560.907481:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892560.907525:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00010000:00010000:3.0:1789892560.907536:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892560.907587:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00010000:00010000:3.0:1789892560.907613:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892560.907616:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3620:x1876834915932928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892560.907634:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836800/0x5c4f93dd00213725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021371e expref: 27 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.907637:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892560.907645:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892560.907658:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 26 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.907659:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789892560.907662:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892560.907663:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892560.907688:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892560.907700:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 26 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.907701:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915934080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892560.907731:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789892560.907739:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915933696:12345-0@lo:103:ldlm_bl.0 Request processed in 496us (1889us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892560.907745:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e000/0x5c4f93dd0021374f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213748 expref: 26 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.907763:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915933824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892560.907782:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00010000:00010000:2.0:1789892560.907783:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892560.907790:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892560.907815:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892560.907835:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 24 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.907847:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934080 00000100:00100000:0.0:1789892560.907857:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934080 00010000:00010000:1.0:1789892560.907868:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 25 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.907905:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 25 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892560.907918:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e800/0x5c4f93dd00213717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213710 expref: 25 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.907922:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915932928:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892560.907966:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1789892560.907980:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00010000:00010000:1.0:1789892560.907982:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892560.908001:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789892560.908012:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915933056:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892560.908032:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00010000:00010000:3.0:1789892560.908035:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892560.908036:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915933952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892560.908062:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.908064:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3620:x1876834915933824:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (1785us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892560.908075:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892560.908099:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3621:x1876834915934080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892560.908100:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.908125:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 23 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.908129:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00010000:00010000:2.0:1789892560.908144:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892560.908166:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 22 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.908190:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 22 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.908198:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915934208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892560.908219:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836c00/0x5c4f93dd00213741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021373a expref: 22 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892560.908226:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 22 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.908259:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892560.908271:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd00213709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213702 expref: 21 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.908283:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892560.908284:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837000/0x5c4f93dd002136ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002136e6 expref: 21 pid: 189434 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.908292:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892560.908315:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892560.908347:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915932672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892560.908386:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915933056:12345-0@lo:103:ldlm_bl.0 Request processed in 385us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892560.908399:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915933696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892560.908406:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1789892560.908424:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915933952:12345-0@lo:103:ldlm_bl.0 Request processed in 394us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892560.908435:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915934080:12345-0@lo:103:ldlm_bl.0 Request processed in 345us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.908448:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789892560.908458:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934208 00000100:00100000:3.0:1789892560.908468:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934208 00000100:00100000:2.0:1789892560.908527:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00010000:00010000:3.0:1789892560.908585:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 17 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892560.908595:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915932928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892560.908657:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915933824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892560.908692:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789892560.908693:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892560.908694:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892560.908726:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3619:x1876834915934208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892560.908747:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915933440 00010000:00010000:3.0:1789892560.908750:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892560.908757:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915933440 00010000:00010000:3.0:1789892560.908766:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 17 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.908786:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 18 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.908814:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 18 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.908844:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f400/0x5c4f93dd002136fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002136f4 expref: 18 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.908869:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892560.908897:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1789892560.908922:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3622:x1876834915933440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892560.908935:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892560.908944:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 17 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.908959:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915934080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892560.908969:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 17 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892560.908992:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3619:x1876834915934208:12345-0@lo:103:ldlm_bl.0 Request processed in 267us (737us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892560.909001:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e600/0x5c4f93dd00213733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021372c expref: 17 pid: 189432 timeout: 3486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.909009:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915933952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892560.909020:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1789892560.909044:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915934208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892560.909059:0:189425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909070:0:189425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892560.909084:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915933056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892560.909090:0:189425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909105:0:189425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909116:0:189425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909137:0:189425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909147:0:189425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f800 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:0.0:1789892560.909153:0:189425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909163:0:189425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909185:0:189425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.909215:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892560.909246:0:216110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.909261:0:216110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892560.909271:0:216110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f800/0x5c4f93dd00213764 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892560.909286:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915933440:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.909303:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1789892560.909366:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915933440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892560.975710:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892560.975932:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857280 00000100:00100000:0.0:1789892560.975947:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857280 00000100:00100000:0.0:1789892560.976018:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2293 00000100:00100000:0.0:1789892560.976028:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925857280:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892560.976043:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892560.976062:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a653 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.976095:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.976111:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.976159:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892560.976240:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925857280:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 212us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.976248:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2293 00000100:00100000:1.0:1789892560.977668:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892560.977755:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857408 00000100:00100000:3.0:1789892560.977779:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857408 00000100:00100000:3.0:1789892560.977833:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2294 00000100:00100000:3.0:1789892560.977847:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925857408:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892560.978034:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925857408:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 189us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892560.978045:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2294 00000100:00100000:3.0:1789892560.979273:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892560.979366:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857536 00000100:00100000:0.0:1789892560.979376:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857536 00000100:00100000:0.0:1789892560.979420:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2295 00000100:00100000:0.0:1789892560.979428:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925857536:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892560.979627:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925857536:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 182us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.979640:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2295 00000100:00100000:2.0:1789892560.981237:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892560.981314:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857664 00000100:00100000:3.0:1789892560.981326:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857664 00000100:00100000:3.0:1789892560.981447:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2296 00000100:00100000:3.0:1789892560.981461:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214697:x1876834925857664:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892560.981676:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214697:x1876834925857664:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 215us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892560.981688:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2296 00000100:00100000:1.0:1789892560.982840:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892560.982942:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857792 00000100:00100000:0.0:1789892560.982950:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857792 00000100:00100000:0.0:1789892560.982987:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2297 00000100:00100000:0.0:1789892560.982995:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214697:x1876834925857792:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892560.983090:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214697:x1876834925857792:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.983097:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2297 00000100:00100000:0.0:1789892560.984302:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892560.984457:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925857920 00000100:00100000:3.0:1789892560.984469:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925857920 00000100:00100000:3.0:1789892560.984552:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2298 00000100:00100000:3.0:1789892560.984571:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214697:x1876834925857920:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892560.984702:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214697:x1876834925857920:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 137us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892560.984716:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2298 00000100:00100000:2.0:1789892560.986174:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892560.986245:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858048 00000100:00100000:0.0:1789892560.986254:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858048 00000100:00100000:0.0:1789892560.986293:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2299 00000100:00100000:0.0:1789892560.986300:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925858048:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892560.986310:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892560.986328:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a65a expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.986349:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.986359:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 10 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892560.986368:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837e00, rc 0) 00000100:00100000:0.0:1789892560.986411:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925858048:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892560.986418:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2299 00000100:00100000:1.0:1789892560.987551:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892560.987624:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858176 00000100:00100000:3.0:1789892560.987636:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858176 00000100:00100000:3.0:1789892560.987697:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2300 00000100:00100000:3.0:1789892560.987710:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925858176:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892560.987827:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925858176:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 117us (274us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892560.987851:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2300 10000000:01000000:3.0:1789892561.506664:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892561.506678:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 180 10000000:01000000:3.0:1789892561.506688:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892561.506777:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.506797:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.506848:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.506926:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.507054:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.507152:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892561.507241:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934336 00000100:00100000:0.0:1789892561.507264:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934336 00000100:00100000:0.0:1789892561.507386:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:0.0:1789892561.507410:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915934336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892561.507435:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892561.507459:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213779 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.507550:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.507568:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.507580:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837c00, rc 0) 00000100:00100000:0.0:1789892561.507691:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915934336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892561.507723:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:3.0:1789892561.507807:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892561.507840:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.507856:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.507990:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.508044:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.508098:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.508166:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934464 00000100:00100000:2.0:1789892561.508179:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934464 00000100:00100000:2.0:1789892561.508253:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1789892561.508266:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915934464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.508604:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915934464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.508617:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:3.0:1789892561.508721:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.508778:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.508848:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.508930:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892561.509017:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934592 00000100:00100000:0.0:1789892561.509028:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934592 00000100:00100000:0.0:1789892561.509084:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:0.0:1789892561.509095:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915934592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.509251:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915934592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892561.509262:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00100000:3.0:1789892561.509314:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.509832:0:216114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216114:1876834915934720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.509921:0:216114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.509970:0:216114:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.510029:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934720 00000100:00100000:2.0:1789892561.510042:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934720 00000100:00100000:2.0:1789892561.510109:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:2.0:1789892561.510128:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216114:x1876834915934720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.510297:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216114:x1876834915934720:12345-0@lo:502:llog_process_th.0 Request processed in 174us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.510309:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00000100:00100000:3.0:1789892561.510359:0:216114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216114:1876834915934720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.510429:0:216114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216114:1876834915934848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.510478:0:216114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.510548:0:216114:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892561.510611:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934848 00000100:00100000:0.0:1789892561.510622:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934848 00000100:00100000:0.0:1789892561.510675:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:0.0:1789892561.510686:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216114:x1876834915934848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892561.510833:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216114:x1876834915934848:12345-0@lo:502:llog_process_th.0 Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892561.510845:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00100000:3.0:1789892561.510910:0:216114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216114:1876834915934848:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892561.510956:0:216114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:0.0:1789892561.511098:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:0.0:1789892561.511140:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892561.511151:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.511168:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892561.511180:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892561.511184:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789892561.511187:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892561.511212:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.511232:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.511244:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.511265:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.511310:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.511340:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.511407:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915934976 00000100:00100000:2.0:1789892561.511420:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915934976 00000100:00100000:2.0:1789892561.511488:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:2.0:1789892561.511561:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915934976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892561.511582:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892561.511610:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213787 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.511642:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.511656:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.511668:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892561.511729:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915934976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.511754:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1789892561.511856:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915934976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892561.511903:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.511918:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.511989:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.512033:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.512078:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.512122:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935104 00000100:00100000:1.0:1789892561.512136:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935104 00000100:00100000:1.0:1789892561.512200:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:1.0:1789892561.512211:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915935104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.512424:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915935104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.512435:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:0.0:1789892561.512556:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.512609:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.512677:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.512722:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.512757:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935232 00000100:00100000:2.0:1789892561.512767:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935232 00000100:00100000:2.0:1789892561.512816:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1789892561.512825:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915935232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.513001:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915935232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.513014:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:0.0:1789892561.513075:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892561.514257:0:216115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:3.0:1789892561.514383:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892561.514418:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892561.514427:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.514443:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892561.514456:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892561.514459:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 180 10000000:01000000:3.0:1789892561.514463:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892561.514530:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.514543:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.514555:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.514578:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.514645:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.514692:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.514730:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935360 00000100:00100000:1.0:1789892561.514743:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935360 00000100:00100000:1.0:1789892561.514803:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:1.0:1789892561.514846:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915935360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892561.514896:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892561.514920:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213795 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.514958:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.514979:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.514991:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801e00, rc 0) 00000100:00100000:1.0:1789892561.515065:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915935360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.515076:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:3.0:1789892561.515138:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892561.515168:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.515185:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.515255:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.515305:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.515336:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.515383:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935488 00000100:00100000:2.0:1789892561.515398:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935488 00000100:00100000:2.0:1789892561.515471:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310 00000100:00100000:2.0:1789892561.515583:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915935488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.515724:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915935488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.515736:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310 00000100:00100000:3.0:1789892561.515778:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.515826:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.515917:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.515956:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.515987:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935616 00000100:00100000:1.0:1789892561.516011:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935616 00000100:00100000:1.0:1789892561.516065:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:1.0:1789892561.516075:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915935616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.516226:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915935616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.516238:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:3.0:1789892561.516293:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915935616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.516776:0:216116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216116:1876834915935744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.516839:0:216116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.516909:0:216116:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.516965:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935744 00000100:00100000:2.0:1789892561.516977:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935744 00000100:00100000:2.0:1789892561.517039:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:2.0:1789892561.517057:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216116:x1876834915935744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.517227:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216116:x1876834915935744:12345-0@lo:502:llog_process_th.0 Request processed in 174us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.517239:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00100000:3.0:1789892561.517278:0:216116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216116:1876834915935744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.517343:0:216116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216116:1876834915935872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.517393:0:216116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.517433:0:216116:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.517556:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915935872 00000100:00100000:1.0:1789892561.517570:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915935872 00000100:00100000:1.0:1789892561.517631:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313 00000100:00100000:1.0:1789892561.517642:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216116:x1876834915935872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892561.517805:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216116:x1876834915935872:12345-0@lo:502:llog_process_th.0 Request processed in 162us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.517825:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313 00000100:00100000:3.0:1789892561.517846:0:216116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216116:1876834915935872:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892561.517919:0:216116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:0.0:1789892561.518026:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:0.0:1789892561.518062:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892561.518072:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.518087:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892561.518099:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789892561.518102:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:0.0:1789892561.518105:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892561.518133:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.518143:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.518154:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.518173:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.518225:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.518270:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.518302:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936000 00000100:00100000:2.0:1789892561.518311:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936000 00000100:00100000:2.0:1789892561.518358:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:2.0:1789892561.518367:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915936000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892561.518397:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892561.518417:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002137a3 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.518458:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.518481:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.518567:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe200, rc 0) 00000100:00100000:2.0:1789892561.518633:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915936000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.518647:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00100000:0.0:1789892561.518679:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892561.518700:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.518712:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.518789:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.518828:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.518895:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.518945:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936128 00000100:00100000:1.0:1789892561.518962:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936128 00000100:00100000:1.0:1789892561.519043:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:1.0:1789892561.519063:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915936128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.519254:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915936128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.519275:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:0.0:1789892561.519302:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.519359:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.519420:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.519448:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.519528:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936256 00000100:00100000:2.0:1789892561.519541:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936256 00000100:00100000:2.0:1789892561.519612:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:2.0:1789892561.519623:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915936256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.519756:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915936256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.519770:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1789892561.519802:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892561.521006:0:216117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789892561.521126:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789892561.521163:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892561.521176:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.521194:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892561.521207:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892561.521210:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 180 10000000:01000000:3.0:1789892561.521214:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892561.521240:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.521251:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.521262:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.521281:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.521328:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.521375:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.521446:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936384 00000100:00100000:1.0:1789892561.521461:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936384 00000100:00100000:1.0:1789892561.521577:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:1.0:1789892561.521596:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915936384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892561.521618:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892561.521641:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002137b1 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.521693:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.521712:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.521727:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800400, rc 0) 00000100:00100000:1.0:1789892561.521816:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915936384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.521839:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:3.0:1789892561.521890:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892561.521916:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.521952:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.522015:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.522064:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.522119:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.522145:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936512 00000100:00100000:2.0:1789892561.522157:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936512 00000100:00100000:2.0:1789892561.522213:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:2.0:1789892561.522224:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915936512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.522352:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915936512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.522387:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:3.0:1789892561.522399:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.522448:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.522551:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.522594:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.522629:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936640 00000100:00100000:1.0:1789892561.522644:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936640 00000100:00100000:1.0:1789892561.522718:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319 00000100:00100000:1.0:1789892561.522737:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915936640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.523462:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915936640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 726us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.523669:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319 00000100:00100000:3.0:1789892561.525294:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915936640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.527776:0:216118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216118:1876834915936768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.527919:0:216118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.527997:0:216118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.528211:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936768 00000100:00100000:2.0:1789892561.528223:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936768 00000100:00100000:2.0:1789892561.528324:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:2.0:1789892561.528336:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216118:x1876834915936768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.528684:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216118:x1876834915936768:12345-0@lo:502:llog_process_th.0 Request processed in 347us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.528700:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00100000:3.0:1789892561.528733:0:216118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216118:1876834915936768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.528811:0:216118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216118:1876834915936896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.528866:0:216118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.528932:0:216118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.528968:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915936896 00000100:00100000:1.0:1789892561.528978:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915936896 00000100:00100000:1.0:1789892561.529029:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:1.0:1789892561.529040:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216118:x1876834915936896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892561.529228:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216118:x1876834915936896:12345-0@lo:502:llog_process_th.0 Request processed in 186us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.529240:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1789892561.529289:0:216118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216118:1876834915936896:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892561.529343:0:216118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:0.0:1789892561.529486:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:0.0:1789892561.529591:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892561.529642:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.529664:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892561.529685:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789892561.529690:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 206 10000000:01000000:0.0:1789892561.529696:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892561.529736:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.529751:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.529792:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.529848:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.529945:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.530002:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.530027:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937024 00000100:00100000:2.0:1789892561.530036:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937024 00000100:00100000:2.0:1789892561.530080:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:2.0:1789892561.530090:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915937024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892561.530102:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892561.530142:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002137bf expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.530190:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.530203:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.530214:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffec00, rc 0) 00000100:00100000:2.0:1789892561.530268:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915937024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.530277:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1789892561.530330:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892561.530351:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.530364:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.530475:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.530573:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.530631:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.530654:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937152 00000100:00100000:1.0:1789892561.530663:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937152 00000100:00100000:1.0:1789892561.530719:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:1.0:1789892561.530728:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915937152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.530906:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915937152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.530918:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:0.0:1789892561.530950:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.531000:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.531056:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.531102:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.531123:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937280 00000100:00100000:2.0:1789892561.531143:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937280 00000100:00100000:2.0:1789892561.531189:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:2.0:1789892561.531198:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915937280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.531354:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915937280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.531364:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:0.0:1789892561.531407:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.531941:0:216119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216119:1876834915937408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892561.531996:0:216119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.532067:0:216119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.532114:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937408 00000100:00100000:1.0:1789892561.532126:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937408 00000100:00100000:1.0:1789892561.532186:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:1.0:1789892561.532197:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216119:x1876834915937408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892561.532337:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216119:x1876834915937408:12345-0@lo:502:llog_process_th.0 Request processed in 140us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.532349:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:0.0:1789892561.532390:0:216119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216119:1876834915937408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892561.532431:0:216119:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892561.532448:0:216119:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892561.532453:0:216119:0:(obd_config.c:1561:class_process_config()) marker 196 (0x1) lustre-MDT0001-m del lustre.qpool1 00000020:00000080:0.0:1789892561.532464:0:216119:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892561.532674:0:216119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216119:1876834915937536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892561.532727:0:216119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.532765:0:216119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.532816:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937536 00000100:00100000:2.0:1789892561.532829:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937536 00000100:00100000:2.0:1789892561.532933:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:2.0:1789892561.532949:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216119:x1876834915937536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.533082:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216119:x1876834915937536:12345-0@lo:502:llog_process_th.0 Request processed in 136us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.533094:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00100000:0.0:1789892561.533136:0:216119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216119:1876834915937536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892561.533177:0:216119:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892561.533184:0:216119:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892561.533186:0:216119:0:(obd_config.c:1561:class_process_config()) marker 196 (0x2) lustre-MDT0001-m del lustre.qpool1 00000040:00080000:0.0:1789892561.533191:0:216119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 209 count 205 00000020:01000000:3.0:1789892561.533346:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 206-208 (rc=0) 10000000:01000000:3.0:1789892561.533381:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892561.533449:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.533469:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892561.533486:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892561.533554:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 180 10000000:01000000:3.0:1789892561.533560:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892561.533597:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.533614:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.533631:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.533655:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.533728:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.533773:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.533794:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937664 00000100:00100000:1.0:1789892561.533804:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937664 00000100:00100000:1.0:1789892561.533848:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:1.0:1789892561.533856:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915937664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892561.533898:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892561.533916:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002137cd expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.533944:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.533957:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.533968:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801400, rc 0) 00000100:00100000:1.0:1789892561.534022:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915937664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.534043:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:3.0:1789892561.534078:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892561.534100:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.534112:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.534168:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.534220:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.534248:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.534308:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937792 00000100:00100000:2.0:1789892561.534320:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937792 00000100:00100000:2.0:1789892561.534378:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1789892561.534393:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915937792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.534597:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915937792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892561.534620:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.534623:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:3.0:1789892561.534676:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.534735:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.534770:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.534863:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915937920 00000100:00100000:1.0:1789892561.534907:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915937920 00000100:00100000:1.0:1789892561.534962:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1789892561.534972:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915937920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.535106:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915937920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.535122:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:3.0:1789892561.535140:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915937920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.535488:0:216120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216120:1876834915938048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.535568:0:216120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.535603:0:216120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.535654:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938048 00000100:00100000:2.0:1789892561.535664:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938048 00000100:00100000:2.0:1789892561.535716:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:2.0:1789892561.535734:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216120:x1876834915938048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.535934:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216120:x1876834915938048:12345-0@lo:502:llog_process_th.0 Request processed in 202us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892561.535967:0:216120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216120:1876834915938048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.535975:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:3.0:1789892561.536037:0:216120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216120:1876834915938176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892561.536092:0:216120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.536118:0:216120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.536156:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938176 00000100:00100000:1.0:1789892561.536168:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938176 00000100:00100000:1.0:1789892561.536219:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:1.0:1789892561.536228:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216120:x1876834915938176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892561.536346:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216120:x1876834915938176:12345-0@lo:502:llog_process_th.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.536357:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00100000:3.0:1789892561.536402:0:216120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216120:1876834915938176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892561.536439:0:216120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:0.0:1789892561.536592:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:0.0:1789892561.536634:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892561.536646:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.536662:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892561.536697:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892561.536700:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 206 10000000:01000000:0.0:1789892561.536704:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892561.536728:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.536738:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.536777:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.536797:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.536847:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.536929:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.536965:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938304 00000100:00100000:2.0:1789892561.536977:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938304 00000100:00100000:2.0:1789892561.537040:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:2.0:1789892561.537057:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915938304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892561.537073:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892561.537093:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002137db expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.537127:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002137db expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.537147:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137db expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892561.537164:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffc00, rc 0) 00000100:00100000:2.0:1789892561.537238:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915938304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.537253:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1789892561.537303:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892561.537332:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892561.537351:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892561.537433:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.537488:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.537586:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.537608:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938432 00000100:00100000:1.0:1789892561.537617:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938432 00000100:00100000:1.0:1789892561.537662:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:1.0:1789892561.537671:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915938432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892561.537789:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915938432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.537798:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1789892561.537859:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.537945:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.538062:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.538102:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.538159:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938560 00000100:00100000:2.0:1789892561.538171:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938560 00000100:00100000:2.0:1789892561.538226:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:2.0:1789892561.538243:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915938560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.538400:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915938560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.538415:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:0.0:1789892561.538466:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892561.538926:0:216121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216121:1876834915938688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892561.539000:0:216121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.539072:0:216121:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.539082:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938688 00000100:00100000:1.0:1789892561.539095:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938688 00000100:00100000:1.0:1789892561.539156:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:1.0:1789892561.539171:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216121:x1876834915938688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892561.539391:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216121:x1876834915938688:12345-0@lo:502:llog_process_th.0 Request processed in 222us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.539401:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:0.0:1789892561.539453:0:216121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216121:1876834915938688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892561.539536:0:216121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892561.539551:0:216121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892561.539555:0:216121:0:(obd_config.c:1561:class_process_config()) marker 195 (0x1) lustre-MDT0000-m del lustre.qpool1 00000020:00000080:0.0:1789892561.539566:0:216121:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892561.540990:0:216121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216121:1876834915938816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892561.541068:0:216121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892561.541118:0:216121:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e5e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.541170:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938816 00000100:00100000:2.0:1789892561.541195:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938816 00000100:00100000:2.0:1789892561.541255:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:2.0:1789892561.541270:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216121:x1876834915938816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892561.541434:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216121:x1876834915938816:12345-0@lo:502:llog_process_th.0 Request processed in 164us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892561.541449:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00100000:0.0:1789892561.541662:0:216121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216121:1876834915938816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892561.541702:0:216121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892561.541728:0:216121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892561.541732:0:216121:0:(obd_config.c:1561:class_process_config()) marker 195 (0x2) lustre-MDT0000-m del lustre.qpool1 00000040:00080000:0.0:1789892561.541740:0:216121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 209 count 205 00000020:01000000:3.0:1789892561.541858:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 206-208 (rc=0) 10000000:01000000:3.0:1789892561.541915:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892561.541927:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.541943:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892561.542012:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892561.542015:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:3.0:1789892561.542019:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892561.542041:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.542051:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.542062:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.542078:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.542116:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.542152:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892561.542192:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915938944 00000100:00100000:1.0:1789892561.542202:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915938944 00000100:00100000:1.0:1789892561.542265:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:1.0:1789892561.542276:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915938944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892561.542288:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892561.542303:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002137e9 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.542345:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.542358:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892561.542367:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801200, rc 0) 00000100:00100000:1.0:1789892561.542440:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915938944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.542450:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:3.0:1789892561.542490:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915938944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892561.542550:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.542586:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892561.542652:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915939072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892561.542702:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.542739:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892561.542794:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939072 00000100:00100000:2.0:1789892561.542806:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939072 00000100:00100000:2.0:1789892561.542902:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:2.0:1789892561.542917:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915939072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892561.543051:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915939072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (343us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892561.543070:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:3.0:1789892561.543091:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915939072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892561.543167:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892561.543175:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.543185:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892561.698825:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892561.698839:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789892561.698903:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915939200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892561.698998:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892561.699082:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939200 00000100:00100000:3.0:1789892561.699095:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939200 00000100:00100000:1.0:1789892561.699214:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789892561.699237:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915939200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892561.699286:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892561.699369:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915939200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892561.699379:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789892561.699453:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915939200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892562.210664:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915939328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892562.210732:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892562.210780:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939328 00000100:00100000:3.0:1789892562.210789:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939328 00000100:00100000:3.0:1789892562.210898:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789892562.210908:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915939328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789892562.210948:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:3.0:1789892562.211000:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915939328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892562.211008:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789892562.211047:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915939328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892562.722724:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915939456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789892562.722770:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892562.722828:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892562.722923:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939456 00000100:00100000:3.0:1789892562.722940:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939456 00000100:00080000:0.0:1789892562.723012:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892562.723044:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789892562.723062:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915939456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789892562.723105:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892562.723196:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915939456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892562.723207:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789892562.723257:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915939456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892562.723355:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915939584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892562.723397:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915939712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892562.723398:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789892562.723418:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915939840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892562.723432:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892562.723535:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892562.723574:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939584 00000100:00100000:3.0:1789892562.723584:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939584 00000100:00100000:1.0:1789892562.723588:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892562.723634:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939840 00000100:00100000:3.0:1789892562.723654:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939712 00000100:00100000:0.0:1789892562.723656:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939840 00000100:00100000:3.0:1789892562.723663:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939712 00000100:00100000:0.0:1789892562.723745:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789892562.723757:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789892562.723766:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915939584:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892562.723780:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915939840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789892562.723799:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789892562.723805:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892562.723913:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915939584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892562.723927:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789892562.723945:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789892562.723946:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915939840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892562.723976:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789892562.723977:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915939712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789892562.724009:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892562.724035:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789892562.724057:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915939968:0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.724091:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915939712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892562.724106:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789892562.724148:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892562.724191:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915939968 00000100:00100000:1.0:1789892562.724200:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915939968 00000100:00100000:0.0:1789892562.724211:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876834915940224:0@lo:400:kworker.0 00000100:00100000:3.0:1789892562.724230:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915940352:0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.724263:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:1.0:1789892562.724289:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915939968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.724289:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789892562.724301:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789892562.724309:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892562.724344:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915940096:0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.724354:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915940736:0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.724368:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915939968:12345-0@lo:400:kworker.0 Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892562.724380:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1789892562.724413:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892562.724426:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892562.724466:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940096 00000100:00100000:1.0:1789892562.724477:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940096 00000100:00100000:3.0:1789892562.724485:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915940608:0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.724612:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789892562.724629:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915940096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.724704:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915940096:12345-0@lo:400:kworker.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892562.724715:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789892562.724933:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915939712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892562.724995:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940224 00000100:00100000:0.0:1789892562.725002:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940224 00000100:00100000:0.0:1789892562.725071:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940736 00000100:00100000:0.0:1789892562.725078:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940736 00000100:00100000:1.0:1789892562.725105:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1789892562.725108:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892562.725184:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915939584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892562.725186:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940608 00000100:00100000:0.0:1789892562.725195:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940608 00000100:00100000:1.0:1789892562.725232:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876834915940224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892562.725240:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915940096:0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.725252:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1789892562.725271:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915940736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892562.725303:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789892562.725324:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915940608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.725426:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876834915940224:12345-0@lo:400:kworker.0 Request processed in 256us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892562.725427:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915940736:12345-0@lo:400:kworker.0 Request processed in 159us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892562.725465:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1789892562.725466:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915940608:12345-0@lo:400:kworker.0 Request processed in 141us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892562.725543:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1789892562.725556:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1789892562.725575:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915940480:0@lo:400:kworker.0 00000100:00080000:3.0:1789892562.725611:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892562.725621:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892562.725633:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789892562.725672:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906985fc4e00 x1876834915940608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892562.725691:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915940608:0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.725712:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915939840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892562.725746:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892562.725777:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876834915940224:0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.725800:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940480 00000100:00100000:3.0:1789892562.725808:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915940864:0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.725809:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940480 00000100:00100000:1.0:1789892562.725831:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915940736:0@lo:400:kworker.0 00000100:00100000:3.0:1789892562.725899:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892562.725919:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940352 00000100:00100000:0.0:1789892562.725926:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940352 00000100:00100000:3.0:1789892562.725961:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915939968:0@lo:400:kworker.0 00000100:00100000:0.0:1789892562.725968:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940864 00000100:00100000:0.0:1789892562.725975:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940864 00000100:00100000:3.0:1789892562.726034:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789892562.726047:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1789892562.726058:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915940480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.726072:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1789892562.726073:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.726109:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915940864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892562.726155:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915940480:12345-0@lo:400:kworker.0 Request processed in 106us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892562.726168:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789892562.726182:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915940352:12345-0@lo:400:kworker.0 Request processed in 119us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892562.726195:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:3.0:1789892562.726217:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892562.726225:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892562.726261:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915940864:12345-0@lo:400:kworker.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892562.726278:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915940352:0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.726279:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00010000:00080000:3.0:1789892562.726324:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906985fc6300 x1876834915940864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892562.726339:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915940864:0@lo:400:kworker.0 00000100:00100000:1.0:1789892562.726404:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915940480:0@lo:400:kworker.0 00000020:00000080:1.0:1789892563.523410:0:216315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffdb5818e90 20000000:00000080:1.0:1789892563.523424:0:216315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90688a9fd400 uarg=0000000000000000 00000040:00100000:1.0:1789892563.524065:0:216315:0:(llog.c:1072:llog_reverse_process()) index 183 : idx 181 00000040:00100000:1.0:1789892563.524073:0:216315:0:(llog.c:1072:llog_reverse_process()) index 179 : idx 137 20000000:01000000:1.0:1789892563.524077:0:216315:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 172 cmd:0xce021 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:1.0:1789892563.524107:0:216315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789892563.524618:0:216316:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 171 marker 185 1->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:1.0:1789892563.524741:0:216316:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 173 marker 185 2->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892563.524767:0:216316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000040:00080000:2.0:1789892563.524968:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].184, 224 off41736 20000000:01000000:2.0:1789892563.524982:0:216315:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892563.524994:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].185, 128 off41864 00000040:00080000:2.0:1789892563.525005:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].186, 224 off42088 20000000:01000000:2.0:1789892563.525015:0:216315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789892563.525304:0:216317:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 197 marker 186 1->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:1.0:1789892563.525346:0:216317:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 199 marker 186 2->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892563.525365:0:216317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 209 count 205 00000040:00080000:2.0:1789892563.525502:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].209, 224 off46544 20000000:01000000:2.0:1789892563.525625:0:216315:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892563.525640:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].210, 136 off46680 00000040:00080000:2.0:1789892563.525660:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].211, 224 off46904 20000000:01000000:2.0:1789892563.525668:0:216315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789892563.526006:0:216318:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 197 marker 187 1->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:1.0:1789892563.526046:0:216318:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 199 marker 187 2->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892563.526063:0:216318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 209 count 205 00000040:00080000:2.0:1789892563.526195:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].209, 224 off46544 20000000:01000000:2.0:1789892563.526212:0:216315:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892563.526224:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].210, 136 off46680 00000040:00080000:2.0:1789892563.526235:0:216315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].211, 224 off46904 10000000:01000000:2.0:1789892563.526243:0:216315:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892563.526260:0:216315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526277:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526283:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526290:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526295:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526300:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526305:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526310:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526314:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526328:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526333:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137db expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526337:0:216315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526344:0:216315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526378:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526389:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 23 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.526404:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915940992:0@lo:104: 00000100:00100000:2.0:1789892563.526482:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892563.526551:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002137db expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526558:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002137db expref: 23 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.526566:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941120:0@lo:104: 00000100:00100000:3.0:1789892563.526570:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915940992 00000100:00100000:3.0:1789892563.526585:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915940992 00000100:00100000:2.0:1789892563.526590:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892563.526620:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526636:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 23 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.526637:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941120 00000100:00100000:3.0:1789892563.526642:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941120 00000100:00100000:0.0:1789892563.526650:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1789892563.526651:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941248:0@lo:104: 00000100:00100000:1.0:1789892563.526669:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789892563.526671:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915940992:12345-0@lo:104: 00000100:00100000:1.0:1789892563.526683:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915941120:12345-0@lo:104: 00010000:00010000:0.0:1789892563.526685:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.526691:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892563.526702:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.526719:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941248 00000100:00100000:3.0:1789892563.526723:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941248 00010000:00010000:2.0:1789892563.526724:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526734:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 23 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.526742:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941376:0@lo:104: 00000100:00100000:3.0:1789892563.526764:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1789892563.526776:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216315:x1876834915941248:12345-0@lo:104: 00010000:00010000:1.0:1789892563.526779:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892563.526786:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.526791:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892563.526792:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216315:x1876834915941120:12345-0@lo:104: Request processed in 109us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892563.526796:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892563.526806:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216315:x1876834915940992:12345-0@lo:104: Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.526813:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789892563.526822:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00010000:2.0:1789892563.526847:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526857:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 23 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.526859:0:193633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789892563.526876:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941504:0@lo:104: 00010000:00010000:3.0:1789892563.526882:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892563.526883:0:189472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:1.0:1789892563.526886:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941376 00000100:00100000:3.0:1789892563.526892:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915941248:12345-0@lo:104: Request processed in 118us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.526893:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941376 00000100:00100000:3.0:1789892563.526905:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00010000:00010000:0.0:1789892563.526906:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789892563.526914:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892563.526918:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.526927:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941504 00010000:00010000:0.0:1789892563.526930:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892563.526932:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941504 00000100:00100000:1.0:1789892563.526934:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 10000000:00010000:0.0:1789892563.526937:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.526946:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915941376:12345-0@lo:104: 00010000:00010000:2.0:1789892563.526948:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.526958:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.526959:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1789892563.526976:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915941504:12345-0@lo:104: 00010000:00010000:0.0:1789892563.526980:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.526981:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 23 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.526989:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892563.527009:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527011:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789892563.527012:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941632:0@lo:104: 10000000:01000000:0.0:1789892563.527022:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892563.527024:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915941376:12345-0@lo:104: Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.527036:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00010000:00010000:3.0:1789892563.527047:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789892563.527055:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915941504:12345-0@lo:104: Request processed in 83us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892563.527064:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.527067:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1789892563.527067:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892563.527077:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892563.527080:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941632 00000100:00100000:1.0:1789892563.527086:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941632 00010000:00010000:3.0:1789892563.527097:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789892563.527103:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527104:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527105:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527117:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00010000:00010000:0.0:1789892563.527128:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836800/0x5c4f93dd002137db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137e2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527132:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ec00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892563.527133:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915941632:12345-0@lo:104: 00010000:00010000:2.0:1789892563.527137:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 23 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892563.527147:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527149:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527153:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789892563.527154:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941888:0@lo:104: 00010000:00010000:0.0:1789892563.527161:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527172:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527177:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892563.527184:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892563.527186:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527189:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892563.527207:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892563.527208:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527211:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527231:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:0.0:1789892563.527231:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527234:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 23 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527235:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527242:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915941632:12345-0@lo:104: Request processed in 110us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.527265:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00010000:00010000:3.0:1789892563.527266:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892563.527267:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942016:0@lo:104: 10000000:01000000:0.0:1789892563.527267:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892563.527283:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941888 00000100:00100000:1.0:1789892563.527288:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941888 00010000:00010000:3.0:1789892563.527291:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527297:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527299:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002137e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137f0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527311:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892563.527312:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00010000:00010000:0.0:1789892563.527321:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892563.527327:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915941888:12345-0@lo:104: 00010000:00010000:3.0:1789892563.527332:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892563.527334:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527336:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527337:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527345:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527352:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002137cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137d4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527365:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892563.527372:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527375:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 23 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527379:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892563.527384:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527387:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527391:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892563.527405:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915941888:12345-0@lo:104: Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892563.527408:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942400:0@lo:104: 00010000:00010000:0.0:1789892563.527410:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892563.527417:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527426:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 10000000:00010000:3.0:1789892563.527437:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527438:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527442:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915942016 00000100:00100000:1.0:1789892563.527447:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915942016 10000000:01000000:3.0:1789892563.527454:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892563.527459:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789892563.527461:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892563.527467:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892563.527471:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915942400 00000100:00100000:1.0:1789892563.527475:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915942400 00010000:00010000:3.0:1789892563.527481:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527514:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892563.527514:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527520:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527524:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00010000:00010000:3.0:1789892563.527526:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527539:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892563.527540:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915942016:12345-0@lo:104: 00010000:00010000:2.0:1789892563.527552:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 9 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527553:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd002137bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137c6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527558:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527559:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527585:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892563.527589:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002137b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137b8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527593:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527608:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892563.527613:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942784:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892563.527617:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837800 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892563.527618:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892563.527621:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216315:x1876834915942016:12345-0@lo:104: Request processed in 82us (314us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892563.527625:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892563.527626:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527645:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f400 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892563.527651:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527652:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527652:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:0.0:1789892563.527671:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527672:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 10000000:00010000:3.0:1789892563.527673:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527689:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915942400:12345-0@lo:104: 10000000:00010000:0.0:1789892563.527693:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892563.527696:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892563.527700:0:216315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527703:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892563.527704:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892563.527727:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.527728:0:216315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 9 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527732:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.527746:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892563.527752:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892563.527756:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892563.527758:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216315:x1876834915942400:12345-0@lo:104: Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892563.527761:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942912:192.168.204.33@tcp:104: 00010000:00010000:3.0:1789892563.527762:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527766:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527774:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00010000:00010000:3.0:1789892563.527787:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837800/0x5c4f93dd002137a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002137aa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527788:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd00213795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021379c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527793:0:216315:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e7d5600 going to sleep for 11 seconds 00010000:00010000:3.0:1789892563.527813:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892563.527817:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915941760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892563.527818:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688b20df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915940992:0@lo:104: 00010000:00010000:3.0:1789892563.527820:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.527827:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892563.527846:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527849:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837400 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892563.527854:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906888f59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941120:0@lo:104: 10000000:00010000:3.0:1789892563.527856:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527871:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941248:0@lo:104: 00010000:00010000:0.0:1789892563.527874:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892563.527882:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892563.527885:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527886:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688243b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941376:0@lo:104: 10000000:00010000:0.0:1789892563.527886:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527904:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915942656:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789892563.527905:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527908:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941504:0@lo:104: 00010000:00010000:0.0:1789892563.527912:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.527929:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941632:0@lo:104: 10000000:01000000:3.0:1789892563.527931:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892563.527935:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892563.527943:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892563.527951:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892563.527952:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915941888:0@lo:104: 00010000:00010000:3.0:1789892563.527958:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527964:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892563.527966:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942016:0@lo:104: 00010000:00010000:0.0:1789892563.527970:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527973:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.527981:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:0.0:1789892563.527981:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892563.527983:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942400:0@lo:104: 00000100:00100000:1.0:1789892563.527994:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915942528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892563.527996:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.527999:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021378e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.528018:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd00213779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213780 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.528023:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892563.528025:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892563.528026:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892563.528029:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892563.528037:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892563.528048:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892563.528050:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892563.528054:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892563.528055:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915942144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892563.528060:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915943296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892563.528061:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892563.528072:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789892563.528080:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915942272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892563.528094:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915943424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892563.528103:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892563.528108:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892563.528123:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915941760 00000100:00100000:1.0:1789892563.528126:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915941760 00000100:00100000:2.0:1789892563.528131:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892563.528143:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915943040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892563.528148:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137db expref: 24 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892563.528154:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915942656 00000100:00100000:0.0:1789892563.528159:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915942656 00000100:00100000:2.0:1789892563.528171:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915943168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892563.528175:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915942528 00000100:00100000:3.0:1789892563.528181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892563.528182:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 25 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.528183:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915942528 00000100:00100000:0.0:1789892563.528206:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915942144 00000100:00100000:0.0:1789892563.528211:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915942144 00010000:00010000:1.0:1789892563.528216:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 26 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.528224:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892563.528229:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 27 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.528247:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915942272 00000100:00100000:0.0:1789892563.528252:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943040 00000100:00100000:1.0:1789892563.528253:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915942272 00000100:00100000:0.0:1789892563.528258:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943040 00010000:00010000:1.0:1789892563.528279:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 29 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.528281:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943168 00010000:00010000:0.0:1789892563.528281:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 29 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.528289:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943168 00010000:00010000:2.0:1789892563.528313:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 30 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.528324:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1789892563.528330:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789892563.528334:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3622:x1876834915941760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892563.528340:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1789892563.528345:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3622:x1876834915942656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892563.528346:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892563.528353:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1789892563.528356:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3622:x1876834915942528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892563.528357:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137db expref: 30 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.528362:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892563.528375:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892563.528376:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+30:3619:x1876834915942144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892563.528376:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 30 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.528379:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002137db expref: 30 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.528385:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 30 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.528395:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892563.528408:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 30 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.528409:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 30 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.528438:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002137db expref: 30 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.528443:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800400/0x5c4f93dd002137b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002137b1 expref: 30 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.528448:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 30 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.528463:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 28 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.528471:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892563.528472:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892563.528482:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801200/0x5c4f93dd002137f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002137e9 expref: 28 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.528505:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffec00/0x5c4f93dd002137c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002137bf expref: 28 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.528519:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892563.528527:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892563.528551:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915941760:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892563.528558:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915942656:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.528563:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1789892563.528569:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915942528:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892563.528585:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3619:x1876834915942144:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.528585:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1789892563.528594:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1789892563.528597:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915942272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892563.528605:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892563.528610:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00010000:00010000:1.0:1789892563.528613:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 24 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.528621:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1789892563.528630:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1789892563.528646:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3619:x1876834915943040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892563.528649:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.528654:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00010000:00010000:3.0:1789892563.528667:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892563.528677:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 22 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.528679:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915943168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892563.528684:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801400/0x5c4f93dd002137d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002137cd expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.528696:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892563.528703:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 21 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892563.528704:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892563.528707:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 21 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892563.528736:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943424 00000100:00100000:0.0:1789892563.528740:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943424 00010000:00010000:0.0:1789892563.528754:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892563.528771:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00010000:00010000:1.0:1789892563.528772:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892563.528778:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892563.528780:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915943424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892563.528789:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892563.528795:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.528801:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe200/0x5c4f93dd002137aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002137a3 expref: 22 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.528807:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801e00/0x5c4f93dd0021379c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213795 expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.528809:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 22 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.528816:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915942272:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (681us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892563.528849:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892563.528849:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00010000:00010000:2.0:1789892563.528857:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892563.528860:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213779 expref: 20 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.528891:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892563.528895:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3619:x1876834915943040:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.528897:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915942272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892563.528904:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3620:x1876834915943168:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892563.528909:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1789892563.528919:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1789892563.528919:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915943168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892563.528949:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915943424:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892563.528957:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915942144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892563.528966:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892563.528966:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1789892563.528977:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915943040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892563.529000:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943296 00000100:00100000:1.0:1789892563.529006:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915943424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892563.529007:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943296 00000100:00100000:2.0:1789892563.529015:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915941760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892563.529029:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915942656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892563.529034:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 16 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892563.529049:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915942528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892563.529070:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1789892563.529088:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3622:x1876834915943296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892563.529097:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892563.529103:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 16 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.529113:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 16 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.529126:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd0021378e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213787 expref: 16 pid: 189432 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892563.529136:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892563.529177:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915943296:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892563.529185:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1789892563.529203:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915943296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892563.529334:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942784:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892563.529340:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216315:1876834915942912:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892563.529373:0:216315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892563.529667:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892563.529732:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892563.529764:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858432 00000100:00100000:3.0:1789892563.529772:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858432 00000100:00100000:2.0:1789892563.529801:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858304 00000100:00100000:2.0:1789892563.529807:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858304 00010000:00010000:3.0:1789892563.529811:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 10 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892563.529827:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 11 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.529851:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 557 00000100:00100000:1.0:1789892563.529863:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 558 00000100:00100000:3.0:1789892563.529864:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925858432:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892563.529883:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892563.529890:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925858304:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892563.529891:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 11 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.529901:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892563.529909:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 11 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.529909:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 11 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.529934:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd0021376b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a653 expref: 11 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.529937:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 11 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.529949:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892563.529956:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837e00/0x5c4f93dd00213772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a65a expref: 10 pid: 189434 timeout: 3488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.529968:0:189425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.529981:0:189425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892563.529983:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2400:x1876834925858432:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892563.530000:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 557 00010000:00010000:1.0:1789892563.530003:0:189425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530011:0:189425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530016:0:189425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530022:0:189425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530027:0:189425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff200 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:1.0:1789892563.530031:0:189425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530037:0:189425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530053:0:189425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.530061:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892563.530068:0:216315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892563.530091:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925858304:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 216us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892563.530098:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 558 00010000:00010000:3.0:1789892563.530114:0:216315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892563.530122:0:216315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff200/0x5c4f93dd002137f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892563.746902:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892564.687759:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892564.687899:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858560 00000100:00100000:2.0:1789892564.687914:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858560 00000100:00100000:2.0:1789892564.688002:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2340 00000100:00100000:2.0:1789892564.688039:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925858560:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892564.688059:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892564.688082:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a661 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892564.688113:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892564.688136:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892564.688145:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffc00, rc 0) 00000100:00100000:2.0:1789892564.688218:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925858560:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 187us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892564.688225:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2340 00000100:00100000:0.0:1789892564.690037:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892564.690132:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858688 00000100:00100000:1.0:1789892564.690142:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858688 00000100:00100000:1.0:1789892564.690234:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2341 00000100:00100000:1.0:1789892564.690253:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925858688:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892564.690579:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925858688:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 238us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892564.690601:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2341 00000100:00100000:3.0:1789892564.691982:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892564.692037:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858816 00000100:00100000:2.0:1789892564.692045:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858816 00000100:00100000:2.0:1789892564.692086:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2342 00000100:00100000:2.0:1789892564.692094:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925858816:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892564.692193:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925858816:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892564.692201:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2342 00000100:00100000:0.0:1789892564.694035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892564.694108:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925858944 00000100:00100000:1.0:1789892564.694117:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925858944 00000100:00100000:1.0:1789892564.694164:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2343 00000100:00100000:1.0:1789892564.694177:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214757:x1876834925858944:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892564.694364:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214757:x1876834925858944:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 186us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892564.694377:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2343 00000100:00100000:0.0:1789892564.695683:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892564.695760:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859072 00000100:00100000:2.0:1789892564.695769:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859072 00000100:00100000:2.0:1789892564.695844:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2344 00000100:00100000:2.0:1789892564.695856:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214757:x1876834925859072:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892564.695956:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214757:x1876834925859072:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892564.695964:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2344 00000100:00100000:3.0:1789892564.697260:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892564.697332:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859200 00000100:00100000:1.0:1789892564.697341:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859200 00000100:00100000:1.0:1789892564.697392:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2345 00000100:00100000:1.0:1789892564.697410:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925859200:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892564.697440:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892564.697476:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a668 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892564.697551:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892564.697569:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892564.697604:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801400, rc 0) 00000100:00100000:1.0:1789892564.697664:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925859200:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 257us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892564.697677:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2345 00000100:00100000:0.0:1789892564.698605:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892564.698658:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859328 00000100:00100000:2.0:1789892564.698664:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859328 00000100:00100000:2.0:1789892564.698695:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2346 00000100:00100000:2.0:1789892564.698702:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925859328:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892564.698766:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925859328:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 61us (160us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892564.698777:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2346 00010000:00010000:3.0:1789892564.770661:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892564.879793:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892564.879875:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892564.879918:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859584 00000100:00100000:3.0:1789892564.879934:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859584 00000100:00100000:1.0:1789892564.879987:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859456 00000100:00100000:1.0:1789892564.879999:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859456 00000100:00100000:3.0:1789892564.880046:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 496 00000100:00080000:2.0:1789892564.880051:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789892564.880063:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892564.880071:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925859584:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892564.880108:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 497 00000100:00100000:0.0:1789892564.880131:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2400:x1876834925859456:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892564.880198:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2400:x1876834925859456:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892564.880200:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925859584:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 127us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892564.880255:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 497 00000100:00100000:3.0:1789892564.880268:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 496 10000000:01000000:2.0:1789892565.090614:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892565.090622:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 184 10000000:01000000:2.0:1789892565.090628:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892565.090685:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.090697:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.090708:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.090735:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915943552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.090827:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.090875:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.090897:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943552 00000100:00100000:1.0:1789892565.090907:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943552 00000100:00100000:1.0:1789892565.090972:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:1.0:1789892565.090983:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915943552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892565.090998:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892565.091014:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021380c expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.091040:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.091051:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.091060:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800c00, rc 0) 00000100:00100000:1.0:1789892565.091110:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915943552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.091118:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:2.0:1789892565.091151:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915943552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892565.091171:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.091181:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.091244:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915943680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.091274:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.091296:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.091334:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943680 00000100:00100000:3.0:1789892565.091341:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943680 00000100:00100000:3.0:1789892565.091384:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:3.0:1789892565.091391:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915943680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.091566:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915943680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.091575:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00100000:2.0:1789892565.091602:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915943680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.091635:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915943808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.091680:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.091705:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.091735:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943808 00000100:00100000:1.0:1789892565.091741:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943808 00000100:00100000:1.0:1789892565.091771:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:1.0:1789892565.091789:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915943808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.091900:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915943808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.091908:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:2.0:1789892565.091937:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915943808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.092335:0:216319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216319:1876834915943936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.092381:0:216319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892565.092407:0:216319:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.092423:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915943936 00000100:00100000:3.0:1789892565.092429:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915943936 00000100:00100000:3.0:1789892565.092460:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:3.0:1789892565.092471:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216319:x1876834915943936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.092621:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216319:x1876834915943936:12345-0@lo:502:llog_process_th.0 Request processed in 150us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.092639:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:1.0:1789892565.092648:0:216319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216319:1876834915943936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.092706:0:216319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216319:1876834915944064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.092754:0:216319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892565.092791:0:216319:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.092824:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944064 00000100:00100000:2.0:1789892565.092831:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944064 00000100:00100000:2.0:1789892565.092897:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1789892565.092910:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216319:x1876834915944064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.093036:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216319:x1876834915944064:12345-0@lo:502:llog_process_th.0 Request processed in 127us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.093064:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:1.0:1789892565.093094:0:216319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216319:1876834915944064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892565.093151:0:216319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789892565.093290:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789892565.093349:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892565.093361:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.093392:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892565.093407:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892565.093411:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:2.0:1789892565.093416:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892565.093446:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.093463:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.093480:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.093553:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.093613:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.093650:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.093708:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944192 00000100:00100000:3.0:1789892565.093732:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944192 00000100:00100000:3.0:1789892565.093765:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:3.0:1789892565.093773:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915944192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.093781:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892565.093791:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021381a expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.093828:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.093849:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.093864:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ec00, rc 0) 00000100:00100000:3.0:1789892565.093904:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915944192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.093911:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1789892565.093947:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892565.093959:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.093968:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.094003:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.094029:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.094078:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.094101:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944320 00000100:00100000:1.0:1789892565.094108:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944320 00000100:00100000:1.0:1789892565.094174:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:1.0:1789892565.094183:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915944320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.094322:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915944320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.094334:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1789892565.094372:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.094427:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.094548:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.094575:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.094635:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944448 00000100:00100000:3.0:1789892565.094645:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944448 00000100:00100000:3.0:1789892565.094695:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:3.0:1789892565.094724:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915944448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.094843:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915944448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.094850:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.094857:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000040:00080000:2.0:1789892565.095758:0:216320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:3.0:1789892565.095852:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892565.095872:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892565.095878:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.095887:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892565.095895:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892565.095897:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 184 10000000:01000000:3.0:1789892565.095899:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892565.095915:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.095922:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.095941:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.095955:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.095986:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.096014:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.096051:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944576 00000100:00100000:1.0:1789892565.096059:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944576 00000100:00100000:1.0:1789892565.096104:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:1.0:1789892565.096113:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915944576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892565.096132:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892565.096142:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213828 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.096159:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.096168:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.096176:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801800, rc 0) 00000100:00100000:1.0:1789892565.096219:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915944576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.096225:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:3.0:1789892565.096266:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.096280:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.096288:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.096331:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.096360:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.096383:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.096425:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944704 00000100:00100000:2.0:1789892565.096433:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944704 00000100:00100000:2.0:1789892565.096475:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:2.0:1789892565.096482:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915944704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.096595:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915944704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.096602:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1789892565.096641:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.096669:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.096723:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.096750:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.096763:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944832 00000100:00100000:1.0:1789892565.096771:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944832 00000100:00100000:1.0:1789892565.096823:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:1.0:1789892565.096836:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915944832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.096929:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915944832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.096938:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1789892565.096966:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915944832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.097234:0:216321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216321:1876834915944960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.097272:0:216321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.097300:0:216321:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e9320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.097314:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915944960 00000100:00100000:2.0:1789892565.097338:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915944960 00000100:00100000:2.0:1789892565.097376:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:2.0:1789892565.097402:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216321:x1876834915944960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.097541:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216321:x1876834915944960:12345-0@lo:502:llog_process_th.0 Request processed in 155us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.097551:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:3.0:1789892565.097565:0:216321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216321:1876834915944960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.097619:0:216321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216321:1876834915945088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.097655:0:216321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.097699:0:216321:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e9320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.097712:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945088 00000100:00100000:1.0:1789892565.097719:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945088 00000100:00100000:1.0:1789892565.097757:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:1.0:1789892565.097765:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216321:x1876834915945088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.097874:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216321:x1876834915945088:12345-0@lo:502:llog_process_th.0 Request processed in 108us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.097893:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:3.0:1789892565.097897:0:216321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216321:1876834915945088:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892565.097928:0:216321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789892565.097994:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789892565.098021:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892565.098052:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.098084:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892565.098097:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892565.098100:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892565.098103:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892565.098138:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.098148:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.098160:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.098178:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.098237:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.098263:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.098284:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945216 00000100:00100000:3.0:1789892565.098291:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945216 00000100:00100000:3.0:1789892565.098325:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:3.0:1789892565.098334:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915945216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.098343:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892565.098353:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213836 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.098369:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.098379:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.098386:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fa00, rc 0) 00000100:00100000:3.0:1789892565.098426:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915945216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.098452:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1789892565.098472:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892565.098494:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.098503:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.098613:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.098650:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892565.098726:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945344 00000100:00100000:2.0:1789892565.098728:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.098733:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945344 00000100:00100000:1.0:1789892565.098766:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:1.0:1789892565.098773:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915945344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.098871:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915945344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.098880:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:2.0:1789892565.098889:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.098923:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.098959:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.098978:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.098997:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945472 00000100:00100000:3.0:1789892565.099002:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945472 00000100:00100000:3.0:1789892565.099038:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:3.0:1789892565.099063:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915945472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.099174:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915945472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.099186:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:2.0:1789892565.099199:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892565.100174:0:216322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789892565.100298:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789892565.100326:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892565.100333:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.100344:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892565.100352:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892565.100354:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 184 10000000:01000000:3.0:1789892565.100357:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892565.100375:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.100383:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.100391:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.100405:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.100439:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.100481:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.100561:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945600 00000100:00100000:1.0:1789892565.100568:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945600 00000100:00100000:1.0:1789892565.100601:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1789892565.100608:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915945600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892565.100617:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892565.100627:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213844 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.100644:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.100653:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.100661:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800200, rc 0) 00000100:00100000:1.0:1789892565.100716:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915945600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.100723:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:3.0:1789892565.100753:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.100775:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.100783:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.100845:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.100876:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.100902:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.100917:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945728 00000100:00100000:2.0:1789892565.100924:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945728 00000100:00100000:2.0:1789892565.100956:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:2.0:1789892565.100962:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915945728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.101075:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915945728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.101089:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:3.0:1789892565.101105:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.101137:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.101176:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.101197:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.101216:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945856 00000100:00100000:1.0:1789892565.101235:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945856 00000100:00100000:1.0:1789892565.101303:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:1.0:1789892565.101316:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915945856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.101420:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915945856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.101433:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:3.0:1789892565.101466:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915945856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.101732:0:216323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216323:1876834915945984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.101766:0:216323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.101810:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915945984 00000100:00100000:2.0:1789892565.101816:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915945984 00000100:00100000:3.0:1789892565.101819:0:216323:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e932840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.101850:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:2.0:1789892565.101857:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216323:x1876834915945984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.101938:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216323:x1876834915945984:12345-0@lo:502:llog_process_th.0 Request processed in 80us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.101946:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:3.0:1789892565.101957:0:216323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216323:1876834915945984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.101998:0:216323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216323:1876834915946112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.102051:0:216323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.102072:0:216323:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.102115:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946112 00000100:00100000:1.0:1789892565.102122:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946112 00000100:00100000:1.0:1789892565.102172:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:1.0:1789892565.102180:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216323:x1876834915946112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.102314:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216323:x1876834915946112:12345-0@lo:502:llog_process_th.0 Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.102329:0:216323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216323:1876834915946112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.102331:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000040:00080000:3.0:1789892565.102364:0:216323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789892565.102473:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789892565.102499:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892565.102538:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.102562:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892565.102570:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892565.102572:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 209 10000000:01000000:2.0:1789892565.102576:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892565.102610:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.102618:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.102627:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.102641:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.102673:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.102720:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946240 00000100:00100000:3.0:1789892565.102726:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946240 00000100:00100000:2.0:1789892565.102728:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.102761:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:3.0:1789892565.102769:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915946240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.102777:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892565.102785:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213852 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.102817:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.102826:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.102832:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f600, rc 0) 00000100:00100000:3.0:1789892565.102874:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915946240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.102880:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1789892565.103010:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892565.103028:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.103041:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.103102:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.103133:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.103164:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.103185:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946368 00000100:00100000:1.0:1789892565.103191:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946368 00000100:00100000:1.0:1789892565.103225:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:1.0:1789892565.103237:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915946368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.103364:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915946368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.103373:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00100000:2.0:1789892565.103380:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.103430:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.103493:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.103575:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.103578:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946496 00000100:00100000:3.0:1789892565.103586:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946496 00000100:00100000:3.0:1789892565.103631:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:3.0:1789892565.103639:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915946496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.103742:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915946496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.103749:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00100000:2.0:1789892565.103766:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.104008:0:216324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216324:1876834915946624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.104076:0:216324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.104124:0:216324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.104141:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946624 00000100:00100000:1.0:1789892565.104149:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946624 00000100:00100000:1.0:1789892565.104183:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:1.0:1789892565.104193:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216324:x1876834915946624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.104417:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216324:x1876834915946624:12345-0@lo:502:llog_process_th.0 Request processed in 223us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.104442:0:216324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216324:1876834915946624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.104464:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000020:01000000:2.0:1789892565.104545:0:216324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892565.104560:0:216324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892565.104564:0:216324:0:(obd_config.c:1561:class_process_config()) marker 199 (0x1) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789892565.104574:0:216324:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892565.104596:0:216324:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:2.0:1789892565.104623:0:216324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216324:1876834915946752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.104664:0:216324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.104720:0:216324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.104725:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946752 00000100:00100000:3.0:1789892565.104749:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946752 00000100:00100000:3.0:1789892565.104777:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:3.0:1789892565.104784:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216324:x1876834915946752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.104882:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216324:x1876834915946752:12345-0@lo:502:llog_process_th.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.104891:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:2.0:1789892565.104915:0:216324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216324:1876834915946752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892565.104945:0:216324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892565.104950:0:216324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892565.104951:0:216324:0:(obd_config.c:1561:class_process_config()) marker 199 (0x2) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789892565.104954:0:216324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 212 count 208 00000020:01000000:3.0:1789892565.105011:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 209-211 (rc=0) 10000000:01000000:3.0:1789892565.105038:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892565.105062:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.105073:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892565.105083:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892565.105085:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 184 10000000:01000000:3.0:1789892565.105088:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892565.105104:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.105129:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.105138:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.105152:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.105183:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.105207:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.105250:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915946880 00000100:00100000:1.0:1789892565.105259:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915946880 00000100:00100000:1.0:1789892565.105303:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1789892565.105316:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915946880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892565.105329:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892565.105340:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213860 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.105358:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.105368:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.105375:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800a00, rc 0) 00000100:00100000:1.0:1789892565.105445:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915946880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.105456:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:3.0:1789892565.105460:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915946880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.105484:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.105546:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.105588:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.105615:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.105651:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947008 00000100:00100000:3.0:1789892565.105654:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.105659:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947008 00000100:00100000:2.0:1789892565.105706:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:2.0:1789892565.105745:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915947008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.105844:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915947008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.105853:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:3.0:1789892565.105865:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.105895:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.105929:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.105948:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.105966:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947136 00000100:00100000:1.0:1789892565.105971:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947136 00000100:00100000:1.0:1789892565.106000:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1789892565.106007:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915947136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.106078:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915947136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.106087:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:3.0:1789892565.106099:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.106313:0:216325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216325:1876834915947264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.106345:0:216325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.106363:0:216325:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993cd9840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.106366:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947264 00000100:00100000:2.0:1789892565.106372:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947264 00000100:00100000:2.0:1789892565.106398:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:2.0:1789892565.106403:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216325:x1876834915947264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.106549:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216325:x1876834915947264:12345-0@lo:502:llog_process_th.0 Request processed in 143us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.106557:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:3.0:1789892565.106569:0:216325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216325:1876834915947264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.106611:0:216325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216325:1876834915947392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.106643:0:216325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.106668:0:216325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.106681:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947392 00000100:00100000:1.0:1789892565.106693:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947392 00000100:00100000:1.0:1789892565.106725:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1789892565.106730:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216325:x1876834915947392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.106819:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216325:x1876834915947392:12345-0@lo:502:llog_process_th.0 Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.106827:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:3.0:1789892565.106840:0:216325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216325:1876834915947392:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892565.106868:0:216325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789892565.106917:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789892565.106948:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892565.106954:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.106963:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892565.106971:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892565.106972:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 209 10000000:01000000:2.0:1789892565.106974:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892565.106989:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.106996:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.107014:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.107027:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.107054:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.107073:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.107082:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947520 00000100:00100000:3.0:1789892565.107088:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947520 00000100:00100000:3.0:1789892565.107125:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:3.0:1789892565.107132:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915947520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.107139:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892565.107147:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021386e expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.107161:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.107169:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.107175:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878fe00, rc 0) 00000100:00100000:3.0:1789892565.107210:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915947520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.107216:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:2.0:1789892565.107222:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892565.107237:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892565.107245:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892565.107280:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.107303:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.107321:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.107349:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947648 00000100:00100000:1.0:1789892565.107357:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947648 00000100:00100000:1.0:1789892565.107392:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1789892565.107403:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915947648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.107524:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915947648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892565.107533:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892565.107535:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1789892565.107573:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.107612:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.107642:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947776 00000100:00100000:2.0:1789892565.107645:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.107648:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947776 00000100:00100000:3.0:1789892565.107680:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1789892565.107686:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915947776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.107758:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915947776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.107767:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1789892565.107779:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915947776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.108013:0:216326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216326:1876834915947904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892565.108066:0:216326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892565.108095:0:216326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.108136:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915947904 00000100:00100000:1.0:1789892565.108142:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915947904 00000100:00100000:1.0:1789892565.108178:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1789892565.108206:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216326:x1876834915947904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.108482:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216326:x1876834915947904:12345-0@lo:502:llog_process_th.0 Request processed in 294us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.108495:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1789892565.108594:0:216326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216326:1876834915947904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892565.108630:0:216326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892565.108639:0:216326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892565.108641:0:216326:0:(obd_config.c:1561:class_process_config()) marker 198 (0x1) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789892565.108646:0:216326:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892565.108658:0:216326:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000020:01000004:2.0:1789892565.109216:0:216327:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789892565.109224:0:216327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:1.0:1789892565.109247:0:216326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216326:1876834915948032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892565.109339:0:216326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892565.109381:0:216326:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688d995540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892565.109395:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948032 00000100:00100000:3.0:1789892565.109401:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948032 00000100:00100000:3.0:1789892565.109441:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:3.0:1789892565.109448:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216326:x1876834915948032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892565.109609:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216326:x1876834915948032:12345-0@lo:502:llog_process_th.0 Request processed in 159us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892565.109626:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1789892565.109669:0:216326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216326:1876834915948032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892565.109699:0:216326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892565.109712:0:216326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892565.109714:0:216326:0:(obd_config.c:1561:class_process_config()) marker 198 (0x2) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892565.109718:0:216326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 212 count 208 00000020:01000000:3.0:1789892565.109794:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 209-211 (rc=0) 10000000:01000000:3.0:1789892565.109848:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892565.109854:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.109865:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892565.109873:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892565.109876:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:3.0:1789892565.109878:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892565.109896:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.109905:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.109913:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.109928:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915948160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.109958:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.109989:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069811ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892565.110006:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948160 00000100:00100000:1.0:1789892565.110014:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948160 00000100:00100000:1.0:1789892565.110074:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:1.0:1789892565.110081:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915948160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892565.110089:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892565.110117:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021387c expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.110137:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.110148:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892565.110156:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800e00, rc 0) 00000100:00100000:1.0:1789892565.110201:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915948160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892565.110208:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:3.0:1789892565.110262:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915948160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892565.110276:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.110298:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892565.110340:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915948288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892565.110379:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892565.110402:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069811ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892565.110422:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948288 00000100:00100000:2.0:1789892565.110429:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948288 00000100:00100000:2.0:1789892565.110474:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1789892565.110482:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915948288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892565.110597:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915948288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892565.110608:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:3.0:1789892565.110623:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915948288:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892565.110661:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892565.110668:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892565.110677:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892565.794651:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892566.184954:0:216425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe2b2f8260 20000000:00000080:1.0:1789892566.184972:0:216425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9069b58ea400 uarg=0000000000000000 00000040:00100000:1.0:1789892566.186161:0:216425:0:(llog.c:1072:llog_reverse_process()) index 186 : idx 181 20000000:01000000:1.0:1789892566.186172:0:216425:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 185 cmd:0xce022 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:1.0:1789892566.186209:0:216425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789892566.186692:0:216426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 168 marker 182 1->4: lustre-clilov new lustre.qpool2 20000000:01000000:1.0:1789892566.186825:0:216426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 170 marker 182 2->4: lustre-clilov new lustre.qpool2 00000040:00080000:1.0:1789892566.186863:0:216426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000040:00080000:3.0:1789892566.187161:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].187, 224 off42312 20000000:01000000:3.0:1789892566.187190:0:216425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:3.0:1789892566.187213:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].188, 104 off42416 00000040:00080000:3.0:1789892566.187249:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].189, 224 off42640 20000000:01000000:3.0:1789892566.187280:0:216425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:3.0:1789892566.187738:0:216427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 194 marker 183 1->4: lustre-MDT0000-mdtlov new lustre.qpool2 20000000:01000000:3.0:1789892566.187760:0:216427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 196 marker 183 2->4: lustre-MDT0000-mdtlov new lustre.qpool2 00000040:00080000:3.0:1789892566.187793:0:216427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 212 count 208 00000040:00080000:1.0:1789892566.187962:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].212, 224 off47128 20000000:01000000:1.0:1789892566.187980:0:216425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892566.187991:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].213, 112 off47240 00000040:00080000:1.0:1789892566.188001:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].214, 224 off47464 20000000:01000000:1.0:1789892566.188012:0:216425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789892566.188233:0:216428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 194 marker 184 1->4: lustre-MDT0001-mdtlov new lustre.qpool2 20000000:01000000:1.0:1789892566.188249:0:216428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 196 marker 184 2->4: lustre-MDT0001-mdtlov new lustre.qpool2 00000040:00080000:1.0:1789892566.188259:0:216428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 212 count 208 00000040:00080000:3.0:1789892566.188380:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].212, 224 off47128 20000000:01000000:3.0:1789892566.188391:0:216425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:3.0:1789892566.188402:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].213, 112 off47240 00000040:00080000:3.0:1789892566.188413:0:216425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].214, 224 off47464 10000000:01000000:3.0:1789892566.188423:0:216425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789892566.188464:0:216425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188486:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188495:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188503:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188549:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188557:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188564:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188572:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188579:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188586:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188592:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188605:0:216425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188613:0:216425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188666:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.188691:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 23 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.188721:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948416:0@lo:104: 00000100:00100000:3.0:1789892566.188803:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892566.188884:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.188888:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948416 00010000:00010000:3.0:1789892566.188894:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 23 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.188899:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948416 00000100:00100000:3.0:1789892566.188907:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948544:0@lo:104: 00000100:00100000:3.0:1789892566.188943:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892566.188971:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948544 00000100:00100000:1.0:1789892566.188976:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948544 00000100:00100000:2.0:1789892566.188997:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00010000:00010000:3.0:1789892566.188999:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.189015:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 23 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.189019:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948416:12345-0@lo:104: 00000100:00100000:1.0:1789892566.189044:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00010000:00010000:2.0:1789892566.189059:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.189068:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948672:0@lo:104: 00000100:00100000:1.0:1789892566.189070:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688a9fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948544:12345-0@lo:104: 00010000:00010000:1.0:1789892566.189106:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.189139:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892566.189182:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892566.189194:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948416:12345-0@lo:104: Request processed in 183us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892566.189204:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948672 00010000:00010000:3.0:1789892566.189206:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.189207:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892566.189208:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1789892566.189223:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948672 00000100:00100000:1.0:1789892566.189234:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688a9fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948544:12345-0@lo:104: Request processed in 170us (284us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892566.189243:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 23 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.189253:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00010000:00010000:2.0:1789892566.189268:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892566.189280:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948800:0@lo:104: 00010000:00010000:2.0:1789892566.189281:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189309:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00010000:00010000:2.0:1789892566.189322:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f800 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892566.189329:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216425:x1876834915948672:12345-0@lo:104: 10000000:00010000:2.0:1789892566.189330:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.189331:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892566.189351:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.189358:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.189359:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892566.189368:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.189404:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892566.189417:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892566.189422:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.189424:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.189457:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892566.189466:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892566.189471:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892566.189474:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 23 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189513:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216425:x1876834915948672:12345-0@lo:104: Request processed in 168us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892566.189556:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948928:0@lo:104: 00000100:00100000:0.0:1789892566.189570:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1789892566.189609:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948800 00000100:00100000:3.0:1789892566.189616:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892566.189616:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948800 00000100:00100000:0.0:1789892566.189684:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915948928 00000100:00100000:0.0:1789892566.189687:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915948928 00010000:00010000:3.0:1789892566.189705:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189713:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00010000:00010000:3.0:1789892566.189720:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 23 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189722:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948800:12345-0@lo:104: 00010000:00010000:0.0:1789892566.189737:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.189739:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949056:0@lo:104: 00000100:00100000:3.0:1789892566.189803:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892566.189855:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892566.189863:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189866:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948800:12345-0@lo:104: Request processed in 143us (521us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892566.189873:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.189881:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892566.189887:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:3.0:1789892566.189899:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 23 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189911:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949056 00010000:00010000:2.0:1789892566.189913:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189918:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949056 00010000:00010000:2.0:1789892566.189922:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f800/0x5c4f93dd0021387c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213883 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.189923:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949312:0@lo:104: 00010000:00010000:2.0:1789892566.189948:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892566.189952:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189958:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00010000:00010000:2.0:1789892566.189965:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ee00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892566.189972:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.189972:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948928:12345-0@lo:104: 00000100:00100000:3.0:1789892566.189974:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892566.189992:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190001:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892566.190012:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892566.190017:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892566.190036:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190048:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.190053:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892566.190056:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 23 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190078:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915948928:12345-0@lo:104: Request processed in 100us (463us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892566.190084:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789892566.190087:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190096:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190111:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1789892566.190116:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949440:0@lo:104: 00000100:00100000:0.0:1789892566.190137:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949312 10000000:01000000:1.0:1789892566.190138:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892566.190140:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878ee00/0x5c4f93dd00213860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213867 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190147:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949312 00010000:00010000:2.0:1789892566.190168:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892566.190172:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892566.190173:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190179:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00010000:00010000:2.0:1789892566.190189:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe400 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892566.190193:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892566.190194:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190195:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915949056:12345-0@lo:104: 00010000:00010000:3.0:1789892566.190201:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.190230:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190240:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.190243:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892566.190249:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 23 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892566.190268:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.190276:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949824:0@lo:104: 00010000:00010000:1.0:1789892566.190283:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892566.190288:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892566.190305:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892566.190306:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd0021386e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213875 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190317:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190325:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915949056:12345-0@lo:104: Request processed in 129us (522us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892566.190331:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892566.190333:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892566.190335:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892566.190346:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.190348:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190360:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:3.0:1789892566.190380:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190383:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe400/0x5c4f93dd00213852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213859 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190394:0:189472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892566.190399:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ea00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892566.190411:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190420:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949440 00010000:00010000:2.0:1789892566.190425:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892566.190431:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949440 00010000:00010000:3.0:1789892566.190436:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 9 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190437:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.190467:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190476:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949824 00000100:00100000:0.0:1789892566.190488:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949824 00010000:00010000:2.0:1789892566.190502:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffea00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:2.0:1789892566.190532:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190541:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892566.190549:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892566.190553:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892566.190556:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892566.190570:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789892566.190577:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915950080:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892566.190587:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190600:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216425:x1876834915949312:12345-0@lo:104: 10000000:01000000:1.0:1789892566.190604:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892566.190613:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892566.190624:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190633:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190665:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021383d expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.190670:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.190677:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892566.190681:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892566.190686:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892566.190691:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892566.190707:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915949184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.190708:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.190739:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021384b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.190740:0:216425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.190740:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892566.190773:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:216425:x1876834915949312:12345-0@lo:104: Request processed in 175us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892566.190830:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892566.190836:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892566.190846:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00010000:00010000:1.0:1789892566.190847:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.190861:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915950208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892566.190862:0:216425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 9 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.190869:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892566.190881:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.190882:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1789892566.190900:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915950464:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892566.190903:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.190909:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892566.190916:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915949440:12345-0@lo:104: 10000000:00010000:1.0:1789892566.190936:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892566.190943:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892566.190943:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.190946:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789892566.190953:0:216425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892566.190970:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915949568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.190979:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.190986:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948416:0@lo:104: 00010000:00010000:1.0:1789892566.190988:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892566.190997:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191013:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd00213828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd0021382f expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.191016:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948544:0@lo:104: 00010000:00010000:0.0:1789892566.191027:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892566.191028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892566.191061:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:216425:x1876834915949440:12345-0@lo:104: Request processed in 151us (884us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892566.191062:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789892566.191065:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948672:0@lo:104: 00010000:00010000:1.0:1789892566.191070:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.191071:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915950336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892566.191103:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00010000:00010000:1.0:1789892566.191106:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffec00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892566.191107:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948800:0@lo:104: 10000000:00010000:1.0:1789892566.191117:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.191122:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892566.191130:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1789892566.191141:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915948928:0@lo:104: 00000100:00100000:0.0:1789892566.191160:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906886fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216425:x1876834915949824:12345-0@lo:104: 00000100:00100000:2.0:1789892566.191164:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915949952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.191168:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.191174:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.191182:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949056:0@lo:104: 10000000:00010000:1.0:1789892566.191187:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.191207:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892566.191208:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949312:0@lo:104: 10000000:01000000:1.0:1789892566.191227:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892566.191251:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949440:0@lo:104: 00000100:00100000:2.0:1789892566.191253:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:1.0:1789892566.191255:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191262:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892566.191265:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915949696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.191280:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191287:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd0021381a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213821 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.191288:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892566.191311:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892566.191312:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906886fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:216425:x1876834915949824:12345-0@lo:104: Request processed in 154us (978us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892566.191316:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892566.191321:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00010000:00010000:1.0:1789892566.191327:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191336:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892566.191341:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915950592:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789892566.191343:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191358:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892566.191365:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892566.191369:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892566.191379:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892566.191384:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892566.191395:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892566.191403:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.191405:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892566.191413:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915950720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.191419:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892566.191420:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949184 00010000:00010000:1.0:1789892566.191446:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.191453:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949184 00010000:00010000:1.0:1789892566.191465:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd0021380c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213813 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.191487:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915949824:0@lo:104: 00010000:00010000:1.0:1789892566.191492:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892566.191498:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 24 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191500:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892566.191544:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892566.191545:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892566.191580:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915950208 00000100:00100000:0.0:1789892566.191586:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915950208 00010000:00010000:0.0:1789892566.191615:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 25 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.191624:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949568 00000100:00100000:1.0:1789892566.191630:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949568 00000100:00100000:2.0:1789892566.191631:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915950336 00000100:00100000:2.0:1789892566.191638:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915950336 00000100:00100000:0.0:1789892566.191640:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949952 00000100:00100000:0.0:1789892566.191649:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949952 00000100:00100000:3.0:1789892566.191650:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915949696 00000100:00100000:3.0:1789892566.191667:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915949696 00010000:00010000:1.0:1789892566.191684:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 28 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.191692:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 28 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.191703:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 29 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.191716:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 29 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.191725:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915950592 00000100:00100000:2.0:1789892566.191737:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915950592 00010000:00010000:2.0:1789892566.191764:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 30 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.191806:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915950720 00000100:00100000:1.0:1789892566.191829:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915950720 00000100:00100000:3.0:1789892566.191835:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1789892566.191844:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789892566.191854:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915949184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.191857:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 31 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.191858:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1789892566.191867:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915950208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892566.191886:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915950336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892566.191923:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892566.191923:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00010000:00010000:0.0:1789892566.191927:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892566.191940:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.191945:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 31 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.191948:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+31:3619:x1876834915949568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892566.191972:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892566.191981:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892566.191989:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.191990:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.191990:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.192069:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 31 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.192089:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.192108:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800200/0x5c4f93dd0021384b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213844 expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.192118:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 31 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.192142:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fa00/0x5c4f93dd0021383d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213836 expref: 30 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.192150:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892566.192150:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213860 expref: 30 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.192159:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800e00/0x5c4f93dd00213883 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021387c expref: 30 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.192171:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892566.192197:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3619:x1876834915950336:12345-0@lo:103:ldlm_bl.0 Request processed in 316us (1076us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892566.192206:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892566.192208:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892566.192210:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1789892566.192242:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1789892566.192247:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915950208:12345-0@lo:103:ldlm_bl.0 Request processed in 389us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892566.192263:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915949696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892566.192271:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1789892566.192281:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915949568:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892566.192289:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915949184:12345-0@lo:103:ldlm_bl.0 Request processed in 438us (1514us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892566.192308:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892566.192318:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00010000:00010000:2.0:1789892566.192323:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 25 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.192359:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 25 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.192364:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1789892566.192365:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915949952:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892566.192385:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00010000:00010000:0.0:1789892566.192395:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892566.192401:0:189473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878fe00/0x5c4f93dd00213875 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021386e expref: 24 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.192408:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00010000:00010000:0.0:1789892566.192409:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 24 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.192443:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915950592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892566.192455:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892566.192462:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892566.192472:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 23 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.192482:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 23 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.192510:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3622:x1876834915949696:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892566.192521:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00010000:00010000:1.0:1789892566.192540:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 22 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.192556:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1789892566.192576:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3622:x1876834915950720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892566.192579:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f600/0x5c4f93dd00213859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213852 expref: 21 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.192586:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801800/0x5c4f93dd0021382f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213828 expref: 21 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.192591:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789892566.192592:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892566.192611:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892566.192613:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 19 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.192621:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915950848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.192621:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892566.192632:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 19 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.192679:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878ec00/0x5c4f93dd00213821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021381a expref: 19 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.192694:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892566.192729:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915949952:12345-0@lo:103:ldlm_bl.0 Request processed in 351us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892566.192751:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915950592:12345-0@lo:103:ldlm_bl.0 Request processed in 313us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892566.192752:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1789892566.192760:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892566.192795:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3622:x1876834915950720:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892566.192837:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1789892566.192849:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1789892566.192884:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915950848 00000100:00100000:1.0:1789892566.192889:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915950848 00010000:00010000:1.0:1789892566.192915:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 16 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.192930:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892566.192957:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1789892566.192963:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915950720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892566.192970:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3620:x1876834915950848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.192979:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892566.192996:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 16 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.192997:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915949696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.193023:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 16 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.193033:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915950592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.193062:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800c00/0x5c4f93dd00213813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021380c expref: 16 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892566.193072:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915949952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.193107:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892566.193146:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915950080:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892566.193190:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216425:1876834915950464:192.168.204.33@tcp:104: 00000100:00100000:1.0:1789892566.193202:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3620:x1876834915950848:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892566.193233:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892566.193248:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1789892566.193251:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915949568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892566.193289:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892566.193294:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915950336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892566.193303:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859712 00000100:00100000:1.0:1789892566.193311:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859712 00000100:00100000:3.0:1789892566.193316:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915949184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892566.193330:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859840 00010000:00010000:0.0:1789892566.193331:0:216425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892566.193336:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915950208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892566.193337:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859840 00010000:00010000:1.0:1789892566.193346:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 10 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892566.193363:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 11 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.193414:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 568 00000100:00100000:0.0:1789892566.193424:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 569 00000100:00100000:3.0:1789892566.193426:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915950848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892566.193435:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925859712:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789892566.193448:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925859840:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892566.193453:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892566.193475:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 11 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193476:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892566.193491:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 11 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.193634:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 11 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193682:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 11 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.193713:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801400/0x5c4f93dd00213805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a668 expref: 11 pid: 189433 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193719:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffc00/0x5c4f93dd002137fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a661 expref: 11 pid: 189432 timeout: 3491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193761:0:199151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193769:0:199151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892566.193793:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892566.193795:0:199151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193804:0:199151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193810:0:199151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193826:0:199151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193832:0:199151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f400 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:0.0:1789892566.193836:0:199151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193842:0:199151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193859:0:199151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892566.193876:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2399:x1876834925859712:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 446us (667us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892566.193886:0:216425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892566.193888:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892566.193898:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 568 00010000:00010000:3.0:1789892566.193906:0:216425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892566.193914:0:216425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f400/0x5c4f93dd0021388a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892566.193925:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2400:x1876834925859840:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 482us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892566.193936:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 569 00000100:00100000:3.0:1789892566.818670:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915950976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892566.818784:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892566.818793:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892566.818875:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915950976 00000100:00100000:0.0:1789892566.818887:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915950976 00000100:00100000:0.0:1789892566.818956:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789892566.818975:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915950976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789892566.819017:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789892566.819081:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915950976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892566.819092:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789892566.819129:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915950976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892567.330821:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789892567.330844:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915951104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892567.330939:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.331025:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951104 00000100:00100000:3.0:1789892567.331036:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951104 00000100:00100000:3.0:1789892567.331110:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789892567.331120:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068886b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915951104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789892567.331162:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:3.0:1789892567.331238:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068886b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915951104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.331246:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789892567.331300:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915951104:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1789892567.650801:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892567.650812:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 187 10000000:01000000:0.0:1789892567.650821:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892567.650886:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.650904:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.650919:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.650952:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.651062:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.651123:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.651250:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951232 00000100:00100000:1.0:1789892567.651273:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951232 00000100:00100000:1.0:1789892567.651389:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:1.0:1789892567.651406:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915951232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892567.651434:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892567.651467:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213891 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.651650:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.651673:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.651692:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801400, rc 0) 00000100:00100000:1.0:1789892567.651857:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915951232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 452us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.651873:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:0.0:1789892567.651950:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892567.651990:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.652006:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.652095:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.652140:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.652179:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.652238:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951360 00000100:00100000:2.0:1789892567.652253:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951360 00000100:00100000:2.0:1789892567.652344:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:2.0:1789892567.652362:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915951360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.652642:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915951360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.652660:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1789892567.652706:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.652800:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.652868:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.652906:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.652985:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951488 00000100:00100000:1.0:1789892567.652997:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951488 00000100:00100000:1.0:1789892567.653049:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:1.0:1789892567.653061:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915951488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.653279:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915951488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.653295:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:0.0:1789892567.653397:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.654031:0:216429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216429:1876834915951616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892567.654097:0:216429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.654138:0:216429:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.654183:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951616 00000100:00100000:2.0:1789892567.654196:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951616 00000100:00100000:2.0:1789892567.654263:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:2.0:1789892567.654277:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216429:x1876834915951616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.654459:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216429:x1876834915951616:12345-0@lo:502:llog_process_th.0 Request processed in 182us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.654484:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00100000:0.0:1789892567.654549:0:216429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216429:1876834915951616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892567.654633:0:216429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216429:1876834915951744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892567.654687:0:216429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.654741:0:216429:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.654797:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951744 00000100:00100000:1.0:1789892567.654810:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951744 00000100:00100000:1.0:1789892567.654872:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1789892567.654884:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216429:x1876834915951744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.655088:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:216429:x1876834915951744:12345-0@lo:502:llog_process_th.0 Request processed in 202us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.655101:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1789892567.655225:0:216429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216429:1876834915951744:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892567.655265:0:216429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:3.0:1789892567.655542:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:3.0:1789892567.655587:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892567.655599:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.655615:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892567.655629:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892567.655632:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892567.655635:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892567.655664:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.655675:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.655686:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.655706:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.655804:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.655864:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.655919:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915951872 00000100:00100000:2.0:1789892567.655930:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915951872 00000100:00100000:2.0:1789892567.655996:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:2.0:1789892567.656008:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915951872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892567.656022:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892567.656044:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd0021389f expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.656121:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.656135:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.656147:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892567.656219:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915951872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.656229:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1789892567.656334:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915951872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892567.656358:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.656371:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.656439:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.656552:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.656595:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.656655:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952000 00000100:00100000:1.0:1789892567.656668:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952000 00000100:00100000:1.0:1789892567.656740:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:1.0:1789892567.656773:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915952000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.656981:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915952000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.656994:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1789892567.657039:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.657088:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.657147:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.657177:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.657282:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952128 00000100:00100000:2.0:1789892567.657293:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952128 00000100:00100000:2.0:1789892567.657349:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:2.0:1789892567.657360:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915952128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.657556:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915952128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.657568:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1789892567.657648:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892567.658978:0:216430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789892567.659098:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789892567.659137:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892567.659150:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.659169:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892567.659185:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892567.659189:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 187 10000000:01000000:0.0:1789892567.659194:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892567.659225:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.659241:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.659267:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.659295:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.659351:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.659409:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.659454:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952256 00000100:00100000:1.0:1789892567.659483:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952256 00000100:00100000:1.0:1789892567.659637:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:1.0:1789892567.659657:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915952256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892567.659672:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892567.659690:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002138ad expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.659721:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.659737:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.659778:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800c00, rc 0) 00000100:00100000:1.0:1789892567.659855:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915952256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.659868:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:0.0:1789892567.659907:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892567.659934:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.659946:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.660049:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.660094:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.660134:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.660176:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952384 00000100:00100000:2.0:1789892567.660191:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952384 00000100:00100000:2.0:1789892567.660262:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:2.0:1789892567.660279:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915952384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.660409:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915952384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.660419:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:0.0:1789892567.660466:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.660536:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.660591:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.660629:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.660686:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952512 00000100:00100000:1.0:1789892567.660699:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952512 00000100:00100000:1.0:1789892567.660775:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:1.0:1789892567.660790:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915952512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.660942:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915952512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.660993:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:0.0:1789892567.660997:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.661389:0:216431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216431:1876834915952640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892567.661469:0:216431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.661548:0:216431:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a65f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.661575:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952640 00000100:00100000:2.0:1789892567.661585:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952640 00000100:00100000:2.0:1789892567.661652:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1789892567.661668:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216431:x1876834915952640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.661864:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216431:x1876834915952640:12345-0@lo:502:llog_process_th.0 Request processed in 200us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.661875:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:0.0:1789892567.661913:0:216431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216431:1876834915952640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892567.661976:0:216431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216431:1876834915952768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892567.662025:0:216431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.662055:0:216431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a00b8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.662117:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952768 00000100:00100000:1.0:1789892567.662130:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952768 00000100:00100000:1.0:1789892567.662183:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:1.0:1789892567.662197:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216431:x1876834915952768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.662344:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:216431:x1876834915952768:12345-0@lo:502:llog_process_th.0 Request processed in 149us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.662357:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:0.0:1789892567.662412:0:216431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216431:1876834915952768:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892567.662458:0:216431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:3.0:1789892567.662585:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:3.0:1789892567.662631:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892567.662641:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.662655:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892567.662667:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892567.662670:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789892567.662673:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892567.662708:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.662726:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.662742:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.662821:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.662888:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.662939:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.662970:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915952896 00000100:00100000:2.0:1789892567.662979:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915952896 00000100:00100000:2.0:1789892567.663023:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:2.0:1789892567.663032:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915952896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892567.663045:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892567.663059:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002138bb expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.663083:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.663096:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.663107:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe400, rc 0) 00000100:00100000:2.0:1789892567.663159:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915952896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.663168:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1789892567.663203:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915952896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892567.663224:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.663235:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.663292:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.663328:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.663358:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.663419:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953024 00000100:00100000:1.0:1789892567.663431:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953024 00000100:00100000:1.0:1789892567.663486:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1789892567.663555:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915953024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.663701:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915953024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.663716:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:3.0:1789892567.663743:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.663834:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.663894:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.663934:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.663972:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953152 00000100:00100000:2.0:1789892567.663981:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953152 00000100:00100000:2.0:1789892567.664024:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:2.0:1789892567.664036:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915953152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.664163:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915953152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.664177:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.664202:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000040:00080000:2.0:1789892567.665437:0:216432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789892567.665590:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789892567.665630:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892567.665640:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.665652:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892567.665675:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892567.665678:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 187 10000000:01000000:3.0:1789892567.665681:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892567.665703:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.665713:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.665723:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.665740:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.665808:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.665845:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.665891:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953280 00000100:00100000:1.0:1789892567.665903:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953280 00000100:00100000:1.0:1789892567.665978:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:1.0:1789892567.666000:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915953280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892567.666015:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892567.666032:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002138c9 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.666061:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.666076:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.666099:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801800, rc 0) 00000100:00100000:1.0:1789892567.666171:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915953280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.666188:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:3.0:1789892567.666215:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892567.666241:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.666255:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.666312:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.666351:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.666377:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.666414:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953408 00000100:00100000:2.0:1789892567.666424:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953408 00000100:00100000:2.0:1789892567.666475:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:2.0:1789892567.666484:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915953408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.666647:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915953408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.666664:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:3.0:1789892567.666668:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.666730:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.666811:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.666847:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.666899:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953536 00000100:00100000:1.0:1789892567.666911:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953536 00000100:00100000:1.0:1789892567.666966:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:1.0:1789892567.666988:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915953536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.667144:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915953536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.667154:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.667169:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:1.0:1789892567.667613:0:216433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216433:1876834915953664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.667679:0:216433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892567.667736:0:216433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069915bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.667772:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953664 00000100:00100000:2.0:1789892567.667782:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953664 00000100:00100000:2.0:1789892567.667845:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1789892567.667853:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216433:x1876834915953664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.667990:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216433:x1876834915953664:12345-0@lo:502:llog_process_th.0 Request processed in 135us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.668000:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1789892567.668072:0:216433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216433:1876834915953664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.668146:0:216433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216433:1876834915953792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.668205:0:216433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892567.668237:0:216433:0:(client.c:2702:ptlrpc_set_wait()) set ffff906985229780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.668280:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953792 00000100:00100000:2.0:1789892567.668289:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953792 00000100:00100000:2.0:1789892567.668332:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:2.0:1789892567.668343:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216433:x1876834915953792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.668458:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:216433:x1876834915953792:12345-0@lo:502:llog_process_th.0 Request processed in 115us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.668468:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1789892567.668580:0:216433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216433:1876834915953792:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892567.668618:0:216433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:3.0:1789892567.668773:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:3.0:1789892567.668835:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892567.668845:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.668857:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892567.668869:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892567.668871:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 212 10000000:01000000:3.0:1789892567.668874:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892567.668899:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.668908:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.668919:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.668937:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.668976:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.669015:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.669036:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915953920 00000100:00100000:2.0:1789892567.669045:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915953920 00000100:00100000:2.0:1789892567.669087:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:2.0:1789892567.669110:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915953920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892567.669123:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892567.669147:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002138d7 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.669169:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.669186:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.669203:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffee00, rc 0) 00000100:00100000:2.0:1789892567.669281:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915953920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.669287:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915953920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.669297:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00010000:00010000:3.0:1789892567.669329:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.669342:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.669410:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.669446:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.669471:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.669547:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954048 00000100:00100000:2.0:1789892567.669556:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954048 00000100:00100000:2.0:1789892567.669614:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:2.0:1789892567.669632:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915954048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.669828:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915954048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.669840:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:3.0:1789892567.669850:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.669891:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.669945:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.669978:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.669994:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954176 00000100:00100000:2.0:1789892567.670001:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954176 00000100:00100000:2.0:1789892567.670036:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1789892567.670046:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915954176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.670148:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915954176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.670159:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.670185:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1789892567.670470:0:216434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216434:1876834915954304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.670570:0:216434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892567.670633:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954304 00000100:00100000:1.0:1789892567.670646:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954304 00000100:00100000:2.0:1789892567.670648:0:216434:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.670710:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:1.0:1789892567.670727:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216434:x1876834915954304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.670927:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216434:x1876834915954304:12345-0@lo:502:llog_process_th.0 Request processed in 204us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.670937:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:2.0:1789892567.670982:0:216434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216434:1876834915954304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892567.671026:0:216434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892567.671040:0:216434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892567.671043:0:216434:0:(obd_config.c:1561:class_process_config()) marker 202 (0x1) lustre-MDT0001-m del lustre.qpool2 00000020:00000080:2.0:1789892567.671049:0:216434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1789892567.671146:0:216434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216434:1876834915954432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.671210:0:216434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892567.671249:0:216434:0:(client.c:2702:ptlrpc_set_wait()) set ffff906993e6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892567.671270:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954432 00000100:00100000:3.0:1789892567.671280:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954432 00000100:00100000:3.0:1789892567.671325:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:3.0:1789892567.671334:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216434:x1876834915954432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892567.671463:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:216434:x1876834915954432:12345-0@lo:502:llog_process_th.0 Request processed in 128us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.671473:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00100000:2.0:1789892567.671580:0:216434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216434:1876834915954432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892567.671611:0:216434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892567.671617:0:216434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892567.671620:0:216434:0:(obd_config.c:1561:class_process_config()) marker 202 (0x2) lustre-MDT0001-m del lustre.qpool2 00000040:00080000:2.0:1789892567.671624:0:216434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 215 count 211 00000020:01000000:3.0:1789892567.671695:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 212-214 (rc=0) 10000000:01000000:3.0:1789892567.671722:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892567.671732:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.671782:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892567.671792:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892567.671794:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 187 10000000:01000000:3.0:1789892567.671798:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892567.671817:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.671826:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.671835:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.671851:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.671884:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.671918:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.671940:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954560 00000100:00100000:1.0:1789892567.671948:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954560 00000100:00100000:1.0:1789892567.671990:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:1.0:1789892567.672000:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915954560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892567.672011:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892567.672022:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002138e5 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.672041:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.672051:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.672058:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800a00, rc 0) 00000100:00100000:1.0:1789892567.672109:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915954560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.672121:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:3.0:1789892567.672131:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892567.672156:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892567.672167:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.672214:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.672249:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.672288:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.672316:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954688 00000100:00100000:2.0:1789892567.672325:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954688 00000100:00100000:2.0:1789892567.672368:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:2.0:1789892567.672379:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915954688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.672478:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915954688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.672525:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00100000:3.0:1789892567.672532:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.672582:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.672630:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.672666:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.672685:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954816 00000100:00100000:1.0:1789892567.672694:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954816 00000100:00100000:1.0:1789892567.672731:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1789892567.672739:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915954816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.672866:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915954816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.672884:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:3.0:1789892567.672894:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915954816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.673285:0:216435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216435:1876834915954944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892567.673335:0:216435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.673358:0:216435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.673388:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915954944 00000100:00100000:2.0:1789892567.673404:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915954944 00000100:00100000:2.0:1789892567.673445:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:2.0:1789892567.673453:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216435:x1876834915954944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.673632:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216435:x1876834915954944:12345-0@lo:502:llog_process_th.0 Request processed in 177us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.673643:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:3.0:1789892567.673662:0:216435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216435:1876834915954944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892567.673715:0:216435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216435:1876834915955072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892567.673784:0:216435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.673817:0:216435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068836b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.673837:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955072 00000100:00100000:1.0:1789892567.673846:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955072 00000100:00100000:1.0:1789892567.673885:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1789892567.673895:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216435:x1876834915955072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.674005:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:216435:x1876834915955072:12345-0@lo:502:llog_process_th.0 Request processed in 108us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.674018:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:3.0:1789892567.674036:0:216435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216435:1876834915955072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892567.674070:0:216435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:0.0:1789892567.674168:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:0.0:1789892567.674197:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892567.674206:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.674235:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892567.674245:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892567.674247:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 212 10000000:01000000:0.0:1789892567.674250:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892567.674272:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.674281:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.674291:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.674307:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.674351:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.674379:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a00b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.674404:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955200 00000100:00100000:2.0:1789892567.674412:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955200 00000100:00100000:2.0:1789892567.674452:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:2.0:1789892567.674459:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915955200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892567.674469:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892567.674481:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002138f3 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.674561:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.674575:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892567.674584:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff000, rc 0) 00000100:00100000:2.0:1789892567.674626:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915955200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.674637:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1789892567.674668:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892567.674684:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.674695:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.674772:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.674805:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.674854:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a00b8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.674861:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955328 00000100:00100000:1.0:1789892567.674870:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955328 00000100:00100000:1.0:1789892567.674910:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:1.0:1789892567.674916:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915955328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892567.675016:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915955328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.675023:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1789892567.675074:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.675110:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.675159:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.675184:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a00b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892567.675221:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955456 00000100:00100000:2.0:1789892567.675231:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955456 00000100:00100000:2.0:1789892567.675281:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:2.0:1789892567.675292:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915955456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.675408:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915955456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.675417:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:0.0:1789892567.675452:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892567.675819:0:216436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216436:1876834915955584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.675868:0:216436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892567.675902:0:216436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698303d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.675925:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955584 00000100:00100000:1.0:1789892567.675937:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955584 00000100:00100000:1.0:1789892567.675989:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1789892567.676006:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216436:x1876834915955584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892567.676171:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216436:x1876834915955584:12345-0@lo:502:llog_process_th.0 Request processed in 170us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.676186:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:2.0:1789892567.676233:0:216436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216436:1876834915955584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892567.676274:0:216436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892567.676282:0:216436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892567.676284:0:216436:0:(obd_config.c:1561:class_process_config()) marker 201 (0x1) lustre-MDT0000-m del lustre.qpool2 00000020:00000080:2.0:1789892567.676289:0:216436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1789892567.677335:0:216436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216436:1876834915955712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892567.677396:0:216436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.677450:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955712 00000100:00100000:2.0:1789892567.677451:0:216436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698303d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892567.677459:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955712 00000100:00100000:3.0:1789892567.677540:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:3.0:1789892567.677556:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216436:x1876834915955712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892567.677666:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:216436:x1876834915955712:12345-0@lo:502:llog_process_th.0 Request processed in 117us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.677675:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1789892567.677719:0:216436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:216436:1876834915955712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892567.677768:0:216436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892567.677775:0:216436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892567.677777:0:216436:0:(obd_config.c:1561:class_process_config()) marker 201 (0x2) lustre-MDT0000-m del lustre.qpool2 00000040:00080000:2.0:1789892567.677781:0:216436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 215 count 211 00000020:01000000:0.0:1789892567.677846:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 212-214 (rc=0) 10000000:01000000:0.0:1789892567.677878:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789892567.677885:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.677893:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892567.677902:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789892567.677904:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:0.0:1789892567.677906:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789892567.677923:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.677931:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.677939:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.677952:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.677984:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.678027:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a00b8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892567.678046:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955840 00000100:00100000:1.0:1789892567.678055:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955840 00000100:00100000:1.0:1789892567.678096:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1789892567.678103:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915955840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892567.678122:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892567.678134:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213901 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.678154:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.678165:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892567.678173:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800000, rc 0) 00000100:00100000:1.0:1789892567.678221:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915955840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.678228:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:0.0:1789892567.678270:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892567.678285:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.678294:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892567.678340:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892567.678373:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.678395:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a00b8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892567.678418:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915955968 00000100:00100000:3.0:1789892567.678429:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915955968 00000100:00100000:3.0:1789892567.678486:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:3.0:1789892567.678566:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915955968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892567.678652:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915955968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (276us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892567.678662:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:0.0:1789892567.678681:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915955968:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789892567.678710:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789892567.678716:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892567.678724:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892567.842910:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915956224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892567.842957:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915956480:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.842967:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915956096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892567.843060:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915956352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892567.843090:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892567.843107:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.843134:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956224 00000100:00100000:0.0:1789892567.843148:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956224 00000100:00100000:3.0:1789892567.843180:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915956736:0@lo:400:kworker.0 00000100:00100000:1.0:1789892567.843190:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915956992:0@lo:400:kworker.0 00000100:00100000:2.0:1789892567.843211:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.843259:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956352 00000100:00100000:0.0:1789892567.843267:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956352 00000100:00100000:3.0:1789892567.843287:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892567.843293:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876834915956864:0@lo:400:kworker.0 00000100:00100000:1.0:1789892567.843342:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956480 00000100:00100000:0.0:1789892567.843354:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789892567.843355:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956480 00000100:00100000:3.0:1789892567.843378:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915957248:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.843383:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915956224:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892567.843391:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789892567.843454:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892567.843460:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892567.843467:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789892567.843479:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915957376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892567.843546:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915956480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892567.843547:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915957760:0@lo:400:kworker.0 00000100:00100000:2.0:1789892567.843646:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.843650:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915956224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.843666:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892567.843681:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915956480:12345-0@lo:400:kworker.0 Request processed in 190us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892567.843681:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789892567.843705:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789892567.843768:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957376 00000100:00100000:0.0:1789892567.843776:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957376 00000100:00100000:2.0:1789892567.843783:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1876834915957888:0@lo:400:kworker.0 00000100:00100000:1.0:1789892567.843799:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789892567.843814:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915956352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892567.843825:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789892567.843844:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915957376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789892567.843911:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789892567.843913:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892567.843928:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915956224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892567.843940:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.844029:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915957376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 185us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892567.844040:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956864 00000100:00100000:3.0:1789892567.844050:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956864 00000100:00100000:1.0:1789892567.844065:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915956352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 235us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892567.844067:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789892567.844088:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915956352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892567.844102:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789892567.844153:0:190944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956736 00000100:00100000:2.0:1789892567.844154:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915957376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892567.844159:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957248 00000100:00100000:0.0:1789892567.844164:0:190944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956736 00000100:00100000:3.0:1789892567.844172:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957248 00000100:00100000:1.0:1789892567.844182:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957760 00000100:00100000:1.0:1789892567.844190:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957760 00000100:00080000:2.0:1789892567.844254:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892567.844257:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957888 00000100:00100000:3.0:1789892567.844264:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957888 00000100:00080000:2.0:1789892567.844266:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789892567.844276:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789892567.844283:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789892567.844289:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00080000:2.0:1789892567.844292:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892567.844304:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915956736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892567.844324:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876834915956864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892567.844334:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1789892567.844356:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789892567.844358:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915957248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.844387:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915956736:12345-0@lo:400:kworker.0 Request processed in 86us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.844393:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915957760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.844408:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789892567.844436:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876834915956864:12345-0@lo:400:kworker.0 Request processed in 123us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.844452:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1789892567.844473:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1789892567.844483:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915957248:12345-0@lo:400:kworker.0 Request processed in 129us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892567.844568:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876834915957888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892567.844569:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1789892567.844583:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876834915957760:12345-0@lo:400:kworker.0 Request processed in 201us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.844608:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892567.844621:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789892567.844668:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915957504:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.844682:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876834915957888:12345-0@lo:400:kworker.0 Request processed in 186us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892567.844699:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1789892567.844775:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876834915956864:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.844776:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956992 00000100:00100000:0.0:1789892567.844792:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956992 00000100:00100000:1.0:1789892567.844796:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892567.844803:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789892567.844849:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9069847a6a00 x1876834915957888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892567.844870:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1876834915957888:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.844892:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789892567.844899:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915956608:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.844918:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915956992:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789892567.844934:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892567.844935:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915956480:0@lo:400:kworker.0 00000100:00100000:3.0:1789892567.844964:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892567.845022:0:190946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956096 00000100:00100000:1.0:1789892567.845034:0:190945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915956608 00000100:00100000:3.0:1789892567.845036:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915957120:0@lo:400:kworker.0 00000100:00100000:2.0:1789892567.845037:0:190946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956096 00000100:00100000:1.0:1789892567.845044:0:190945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915956608 00000100:00100000:0.0:1789892567.845058:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3621:x1876834915956992:12345-0@lo:400:kworker.0 Request processed in 146us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892567.845069:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789892567.845121:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.845128:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789892567.845148:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789892567.845156:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915956608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892567.845165:0:190945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957120 00000100:00100000:1.0:1789892567.845175:0:190945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957120 00000100:00100000:2.0:1789892567.845177:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915956096:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892567.845180:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1876834915957632:0@lo:400:kworker.0 00002000:00000024:2.0:1789892567.845226:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892567.845242:0:190945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789892567.845258:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915956608:12345-0@lo:400:kworker.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.845278:0:190945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915957120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892567.845281:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892567.845299:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789892567.845312:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915956096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.845348:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00010000:0.0:1789892567.845353:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892567.845397:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906985fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915956096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892567.845419:0:190945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915957120:12345-0@lo:400:kworker.0 Request processed in 163us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.845432:0:190945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789892567.845445:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915956992:0@lo:400:kworker.0 00000100:00100000:3.0:1789892567.845452:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915956608:0@lo:400:kworker.0 00000100:00100000:2.0:1789892567.845465:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957504 00000100:00100000:2.0:1789892567.845475:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957504 00000100:00100000:1.0:1789892567.845525:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915957632 00000100:00100000:1.0:1789892567.845532:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915957632 00000100:00100000:3.0:1789892567.845544:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915957120:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.845596:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915957248:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.845640:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1876834915957760:0@lo:400:kworker.0 00000100:00080000:3.0:1789892567.845642:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892567.845659:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892567.845686:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789892567.845688:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915956736:0@lo:400:kworker.0 00000100:00100000:2.0:1789892567.845724:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789892567.845727:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876834915957632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892567.845781:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915957504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892567.845829:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1876834915957632:12345-0@lo:400:kworker.0 Request processed in 113us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892567.845841:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00010000:00080000:3.0:1789892567.845893:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9069847a6680 x1876834915957632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892567.845894:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876834915957504:12345-0@lo:400:kworker.0 Request processed in 145us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892567.845926:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1789892567.845931:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1876834915957632:0@lo:400:kworker.0 00000100:00100000:0.0:1789892567.845953:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1876834915957504:0@lo:400:kworker.0 00000100:00100000:3.0:1789892568.208307:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892568.208351:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925859968 00000100:00100000:1.0:1789892568.208360:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925859968 00000100:00100000:1.0:1789892568.208417:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2423 00000100:00100000:1.0:1789892568.208427:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925859968:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892568.208443:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892568.208459:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a66f expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.208483:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.208513:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.208521:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801a00, rc 0) 00000100:00100000:1.0:1789892568.208570:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925859968:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 145us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892568.208577:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2423 00000100:00100000:3.0:1789892568.209284:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892568.209321:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860096 00000100:00100000:0.0:1789892568.209326:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860096 00000100:00100000:0.0:1789892568.209354:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2424 00000100:00100000:0.0:1789892568.209361:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925860096:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892568.209466:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925860096:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 106us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892568.209473:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2424 00000100:00100000:3.0:1789892568.210232:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892568.210272:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860224 00000100:00100000:1.0:1789892568.210277:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860224 00000100:00100000:1.0:1789892568.210304:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2425 00000100:00100000:1.0:1789892568.210310:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925860224:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892568.210381:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925860224:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892568.210394:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2425 00000100:00100000:0.0:1789892568.211244:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892568.211266:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860352 00000100:00100000:3.0:1789892568.211271:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860352 00000100:00100000:3.0:1789892568.211303:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2426 00000100:00100000:3.0:1789892568.211358:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214779:x1876834925860352:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892568.211441:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214779:x1876834925860352:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 131us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892568.211448:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2426 00000100:00100000:3.0:1789892568.212140:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892568.212180:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860480 00000100:00100000:2.0:1789892568.212186:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860480 00000100:00100000:2.0:1789892568.212218:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2427 00000100:00100000:2.0:1789892568.212225:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214779:x1876834925860480:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892568.212305:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:214779:x1876834925860480:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892568.212310:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2427 00000100:00100000:0.0:1789892568.213104:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892568.213174:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860608 00000100:00100000:3.0:1789892568.213179:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860608 00000100:00100000:3.0:1789892568.213206:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2428 00000100:00100000:3.0:1789892568.213212:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925860608:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892568.213219:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892568.213229:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a676 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.213245:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.213252:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.213258:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e000, rc 0) 00000100:00100000:3.0:1789892568.213284:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925860608:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892568.213290:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2428 00000100:00100000:0.0:1789892568.213867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892568.213899:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860736 00000100:00100000:2.0:1789892568.213904:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860736 00000100:00100000:2.0:1789892568.213930:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2429 00000100:00100000:2.0:1789892568.213937:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925860736:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892568.213993:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925860736:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 56us (127us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892568.213999:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2429 00000100:00100000:0.0:1789892568.538361:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892568.538413:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925860864 00000100:00100000:2.0:1789892568.538425:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925860864 00000100:00080000:3.0:1789892568.538468:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892568.538527:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2800 00000100:00100000:2.0:1789892568.538549:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:214803:x1876834925860864:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:2.0:1789892568.538571:0:189439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892568.538593:0:189439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd0021391d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a67d expref: -99 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538657:0:189439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538673:0:189439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538688:0:189439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538705:0:189439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538714:0:189439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538721:0:189439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538818:0:189439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe800/0x5c4f93dd00213932 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538829:0:189439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe800/0x5c4f93dd00213932 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538837:0:189439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe800/0x5c4f93dd00213932 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789892568.538887:0:189439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000004:00200000:2.0:1789892568.538892:0:189439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789892568.538912:0:189439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe800/0x5c4f93dd00213932 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538925:0:189439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538933:0:189439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538941:0:189439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538948:0:189439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe200 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892568.538953:0:189439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538961:0:189439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538975:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9ade100) 00010000:00010000:2.0:1789892568.538978:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892568.538983:0:189439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.538991:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe200/0x5c4f93dd00213924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539002:0:189439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539021:0:189439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539028:0:189439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539035:0:189439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffec00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:2.0:1789892568.539039:0:189439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539046:0:189439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539055:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff90699b3b2d00) 00010000:00010000:2.0:1789892568.539059:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892568.539062:0:189439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539068:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffec00/0x5c4f93dd0021392b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539101:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884fffc00/0x5c4f93dd0021391d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a67d expref: 8 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539117:0:189439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe800/0x5c4f93dd00213932 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a67d expref: 7 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892568.539125:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90699b3b2f00) 00010000:00010000:2.0:1789892568.539128:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789892568.539138:0:189439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffe800, rc 0) 00000100:00100000:2.0:1789892568.539200:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+7:214803:x1876834925860864:12345-192.168.204.33@tcp:101:rm.0 Request processed in 654us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892568.539208:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2800 00000100:00100000:0.0:1789892568.540345:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892568.540386:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925861120 00000100:00100000:3.0:1789892568.540391:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925861120 00000100:00100000:3.0:1789892568.540421:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2801 00000100:00100000:3.0:1789892568.540427:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+7:214803:x1876834925861120:12345-192.168.204.33@tcp:101:rm.0 00010000:00010000:3.0:1789892568.540435:0:191135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892568.540444:0:191135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a684 expref: -99 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789892568.540519:0:191135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:3.0:1789892568.540624:0:191135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213939 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a684 expref: 9 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.540636:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9ade100) 00010000:00010000:3.0:1789892568.540640:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789892568.540644:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a684 expref: 9 pid: 191135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.540656:0:191135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f600, rc 0) 00000100:00100000:3.0:1789892568.540693:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+8:214803:x1876834925861120:12345-192.168.204.33@tcp:101:rm.0 Request processed in 266us (350us total) trans 12884904338 rc 301/301 00000100:00100000:3.0:1789892568.540699:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2801 00000001:00080000:1.0:1789892568.541593:0:189419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904338 is committed 00000100:00100000:0.0:1789892568.542245:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892568.542288:0:190971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925861248 00000100:00100000:1.0:1789892568.542293:0:190971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925861248 00000100:00100000:1.0:1789892568.542325:0:190971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:1.0:1789892568.542331:0:190971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af48f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:082b2a23-8951-488c-926f-5ad884776d61+7:214803:x1876834925861248:12345-192.168.204.33@tcp:37:rm.0 00000100:00100000:2.0:1789892568.544072:0:190971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af48f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:082b2a23-8951-488c-926f-5ad884776d61+7:214803:x1876834925861248:12345-192.168.204.33@tcp:37:rm.0 Request processed in 1740us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892568.544079:0:190971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:0.0:1789892568.545336:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892568.545361:0:193748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925861504 00000100:00100000:3.0:1789892568.545367:0:193748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925861504 00000100:00100000:3.0:1789892568.545396:0:193748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 198 00000100:00100000:3.0:1789892568.545402:0:193748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:082b2a23-8951-488c-926f-5ad884776d61+7:214803:x1876834925861504:12345-192.168.204.33@tcp:35:rm.0 00000100:00100000:3.0:1789892568.545553:0:193748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:082b2a23-8951-488c-926f-5ad884776d61+8:214803:x1876834925861504:12345-192.168.204.33@tcp:35:rm.0 Request processed in 148us (214us total) trans 12884904339 rc 0/0 00000100:00100000:3.0:1789892568.545560:0:193748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 198 00000100:00100000:0.0:1789892568.546546:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892568.546580:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925861760 00000100:00100000:1.0:1789892568.546586:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925861760 00000100:00100000:1.0:1789892568.546617:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2802 00000100:00100000:1.0:1789892568.546624:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+8:214803:x1876834925861760:12345-192.168.204.33@tcp:36:rm.0 00010000:00010000:1.0:1789892568.546649:0:191771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789892568.546661:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906884ffe800/0x5c4f93dd00213932 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a67d expref: 8 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546672:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff90699b3b2f00) 00010000:00010000:1.0:1789892568.546680:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fc00/0x5c4f93dd0021333c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a5f1 expref: 7 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546686:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9ade100) 00010000:00010000:1.0:1789892568.546690:0:191771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892568.546702:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546709:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546715:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546747:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546753:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546759:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546800:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546806:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546811:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892568.546938:0:191771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:1.0:1789892568.546946:0:191771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546951:0:191771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546956:0:191771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546960:0:191771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800400 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892568.546962:0:191771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546990:0:191771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.546996:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff906983271600) 00010000:00010000:1.0:1789892568.546998:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789892568.547000:0:191771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547005:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800400/0x5c4f93dd00213955 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547018:0:191771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547023:0:191771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547027:0:191771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547030:0:191771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801200 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892568.547032:0:191771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547036:0:191771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547040:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff906983271700) 00010000:00010000:1.0:1789892568.547041:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892568.547043:0:191771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547054:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801200/0x5c4f93dd00213947 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789892568.547062:0:191771:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000091ee8acf reply state 00000000e8997d6a transno 12884904340 ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547070:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892568.547075:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff906983271e00) 00010000:00010000:1.0:1789892568.547077:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789892568.547078:0:191771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789892568.547112:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+8:214803:x1876834925861760:12345-192.168.204.33@tcp:36:rm.0 Request processed in 488us (566us total) trans 12884904340 rc 0/0 00000100:00100000:1.0:1789892568.547117:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2802 00000100:00100000:1.0:1789892568.548565:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892568.548610:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925861888 00000100:00100000:0.0:1789892568.548616:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925861888 00000100:00100000:0.0:1789892568.548648:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2803 00000100:00100000:0.0:1789892568.548655:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+8:213289:x1876834925861888:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:0.0:1789892568.548665:0:189438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892568.548675:0:189438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd0021395c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a68b expref: -99 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892568.548715:0:189438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837200/0x5c4f93dd00213963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892568.548725:0:189438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990837200/0x5c4f93dd00213963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892568.548750:0:189438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837200/0x5c4f93dd00213963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892568.548782:0:189438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789892568.548785:0:189438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892568.548796:0:189438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906990837200/0x5c4f93dd00213963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892568.548810:0:189438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd0021395c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a68b expref: 10 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892568.548830:0:189438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837200/0x5c4f93dd00213963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a68b expref: 9 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892568.548835:0:189438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42300) 00010000:00010000:0.0:1789892568.548837:0:189438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892568.548839:0:189438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892568.548867:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+9:213289:x1876834925861888:12345-192.168.204.33@tcp:101:bash.0 Request processed in 213us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892568.548872:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2803 00000100:00100000:0.0:1789892568.549669:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892568.549708:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862016 00000100:00100000:3.0:1789892568.549714:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862016 00000100:00100000:3.0:1789892568.549755:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2804 00000100:00100000:3.0:1789892568.549762:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+9:213289:x1876834925862016:12345-192.168.204.33@tcp:101:bash.0 00010000:00010000:3.0:1789892568.549773:0:196796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892568.549791:0:196796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd0021396a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a692 expref: -99 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549829:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549841:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549848:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549857:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549861:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549866:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549881:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549885:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549889:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549893:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e800 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892568.549896:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549909:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549915:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42300) 00010000:00010000:3.0:1789892568.549917:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892568.549920:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549924:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd00213971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549931:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549935:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549939:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549943:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878fa00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892568.549944:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549948:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549952:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7443287c (ffff9069a9adef00) 00010000:00010000:3.0:1789892568.549953:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892568.549955:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549962:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd00213978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549980:0:196796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd0021396a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a692 expref: 10 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.549986:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42300) 00010000:00010000:3.0:1789892568.549988:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892568.549990:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd0021396a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a692 expref: 10 pid: 196796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892568.550022:0:196796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f600, rc 0) 00000100:00100000:3.0:1789892568.550051:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+9:213289:x1876834925862016:12345-192.168.204.33@tcp:101:bash.0 Request processed in 290us (385us total) trans 0 rc 301/301 00000100:00100000:3.0:1789892568.550057:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2804 00010000:00010000:1.0:1789892568.866713:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789892569.732585:0:216651:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892569.732596:0:216651:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1789892569.778998:0:216671:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892569.779006:0:216671:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789892569.890686:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892569.999368:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892569.999421:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892569.999433:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862272 00000100:00100000:2.0:1789892569.999445:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862272 00000100:00100000:0.0:1789892569.999471:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892569.999475:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862144 00000100:00100000:1.0:1789892569.999482:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862144 00000100:00100000:2.0:1789892569.999531:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862400 00000100:00100000:2.0:1789892569.999538:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862400 00000100:00100000:0.0:1789892569.999544:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 504 00000100:00100000:1.0:1789892569.999549:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2430 00000100:00100000:1.0:1789892569.999565:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925862144:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892569.999566:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+9:2399:x1876834925862272:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892569.999587:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 505 00000100:00100000:2.0:1789892569.999600:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+5:2400:x1876834925862400:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892569.999631:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2400:x1876834925862144:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892569.999635:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+9:2399:x1876834925862272:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892569.999641:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2430 00000100:00100000:2.0:1789892569.999648:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+5:2400:x1876834925862400:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892569.999655:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 504 00000100:00100000:2.0:1789892569.999664:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 505 00000100:00080000:2.0:1789892569.999714:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1789892570.220186:0:189419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904340 is committed 00010000:00010000:3.0:1789892570.220218:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892570.220231:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892570.220241:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892570.220248:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801e00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892570.220253:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892570.220273:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892570.220309:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff906983271e00) 00010000:00010000:3.0:1789892570.220313:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892570.220318:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892570.220326:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801e00/0x5c4f93dd0021394e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789892570.659305:0:216774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3395807810929ns, next at 3277500567060ns, rc = 0 00080000:00080000:1.0:1789892570.659327:0:216774:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789892570.659431:0:216774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3395807939844ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789892570.659437:0:216774:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789892570.659524:0:216774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3395808032894ns, next at 3206864919340ns, rc = 0 00080000:00080000:1.0:1789892570.659530:0:216774:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789892570.659605:0:216774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3395808113826ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789892570.659609:0:216774:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789892570.660082:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 37 committed 00000004:00080000:0.0:1789892570.660292:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000004:00080000:2.0:1789892570.660582:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 37 committed 00000004:00080000:0.0:1789892570.660612:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00010000:00010000:3.0:1789892570.914675:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892571.106839:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892571.106891:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862528 00000100:00100000:3.0:1789892571.106903:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862528 00000100:00080000:2.0:1789892571.106949:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892571.106980:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2805 00000100:00100000:3.0:1789892571.106994:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906985fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:215127:x1876834925862528:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892571.109581:0:191135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958016:0@lo:106: 00000100:00100000:3.0:1789892571.109636:0:191135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892571.109699:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958016 00000100:00100000:1.0:1789892571.109706:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958016 00000100:00100000:3.0:1789892571.109729:0:191135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a70000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958144:0@lo:106: 00000100:00100000:1.0:1789892571.109753:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1789892571.109763:0:191135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892571.109769:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:191135:x1876834915958016:12345-0@lo:106: 00010000:00010000:1.0:1789892571.109785:0:189472:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892571.109797:0:189472:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892571.109804:0:191135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885a73800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958272:0@lo:106: 00000100:00100000:3.0:1789892571.109841:0:191135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892571.109876:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:191135:x1876834915958016:12345-0@lo:106: Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892571.109883:0:191135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068825c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958528:0@lo:106: 00000100:00100000:1.0:1789892571.109890:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1789892571.109912:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958144 00000100:00100000:1.0:1789892571.109916:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958144 00000100:00100000:3.0:1789892571.109921:0:191135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892571.109949:0:191135:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688e401a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892571.109953:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958272 00000100:00100000:1.0:1789892571.109958:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958272 00000100:00100000:3.0:1789892571.109980:0:191135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958016:0@lo:106: 00000100:00100000:1.0:1789892571.109981:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958528 00000100:00100000:1.0:1789892571.109987:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958528 00000100:00100000:1.0:1789892571.110014:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1789892571.110026:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:191135:x1876834915958144:12345-0@lo:106: 00000100:00100000:3.0:1789892571.110032:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00010000:00010000:1.0:1789892571.110037:0:189472:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892571.110043:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:191135:x1876834915958272:12345-0@lo:106: 00000100:00100000:0.0:1789892571.110052:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915958400:0@lo:601:lquota_wb_lustr.0 00010000:00010000:3.0:1789892571.110057:0:189422:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892571.110060:0:189472:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892571.110078:0:189422:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892571.110101:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892571.110140:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789892571.110148:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915958656:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892571.110152:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:191135:x1876834915958144:12345-0@lo:106: Request processed in 126us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892571.110154:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:191135:x1876834915958272:12345-0@lo:106: Request processed in 110us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892571.110169:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1789892571.110177:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1789892571.110192:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1789892571.110195:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892571.110206:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:191135:x1876834915958528:12345-0@lo:106: 00010000:00010000:1.0:1789892571.110216:0:189472:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892571.110225:0:189472:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892571.110280:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:191135:x1876834915958528:12345-0@lo:106: Request processed in 79us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892571.110289:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1789892571.110441:0:193750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958400 00000100:00100000:3.0:1789892571.110445:0:193750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958400 00000100:00100000:3.0:1789892571.110487:0:193750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958656 00000100:00100000:3.0:1789892571.110511:0:193750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958656 00000100:00100000:0.0:1789892571.110526:0:190971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789892571.110536:0:190971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+9:3621:x1876834915958400:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892571.110553:0:189442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789892571.110563:0:189442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+9:3621:x1876834915958656:12345-0@lo:601:lquota_wb_lustr.0 00000100:00080000:3.0:1789892571.110567:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892571.110594:0:190971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+9:3621:x1876834915958400:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892571.110601:0:190971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789892571.110609:0:191135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a70000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958144:0@lo:106: 00000100:00100000:1.0:1789892571.110625:0:189442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915958656:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 62us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892571.110627:0:191135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885a73800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958272:0@lo:106: 00000100:00100000:1.0:1789892571.110642:0:189442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789892571.110644:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915958656:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892571.110648:0:191135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068825c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:191135:1876834915958528:0@lo:106: 00000100:00100000:0.0:1789892571.110669:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915958400:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892571.110675:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915958784:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892571.110725:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892571.110742:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906985fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:215127:x1876834925862528:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 3750us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892571.110748:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789892571.110750:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2805 00000100:00100000:1.0:1789892571.110763:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915958912:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892571.110785:0:193748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958784 00000100:00100000:3.0:1789892571.110790:0:193748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958784 00000100:00100000:1.0:1789892571.110795:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892571.110827:0:193748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915958912 00000100:00100000:3.0:1789892571.110830:0:193748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915958912 00000100:00100000:3.0:1789892571.110850:0:193748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789892571.110857:0:193748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+9:3619:x1876834915958784:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892571.110860:0:190971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789892571.110870:0:190971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+9:3619:x1876834915958912:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892571.110911:0:190971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+9:3619:x1876834915958912:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892571.110918:0:190971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789892571.110942:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915958912:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892571.110958:0:193748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876834915958784:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892571.110964:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1876834915958784:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892571.110968:0:193748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1789892571.110998:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892571.126170:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892571.126211:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862656 00000100:00100000:0.0:1789892571.126221:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862656 00000100:00100000:0.0:1789892571.126272:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2806 00000100:00100000:0.0:1789892571.126282:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:215130:x1876834925862656:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:0.0:1789892571.127609:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:215130:x1876834925862656:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1326us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892571.127619:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2806 00000100:00100000:0.0:1789892571.142352:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892571.142405:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862784 00000100:00100000:1.0:1789892571.142414:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862784 00000100:00100000:1.0:1789892571.142461:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2807 00000100:00100000:1.0:1789892571.142470:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:215133:x1876834925862784:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:1.0:1789892571.144725:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:215133:x1876834925862784:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 2252us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892571.144737:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2807 00000100:00100000:1.0:1789892571.160444:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892571.160529:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925862912 00000100:00100000:0.0:1789892571.160540:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925862912 00000100:00100000:0.0:1789892571.160599:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2808 00000100:00100000:0.0:1789892571.160611:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:215136:x1876834925862912:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:0.0:1789892571.162325:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:215136:x1876834925862912:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1714us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892571.162334:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2808 00000100:00100000:0.0:1789892571.175345:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892571.175395:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863040 00000100:00100000:2.0:1789892571.175405:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863040 00000100:00100000:2.0:1789892571.175453:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2809 00000100:00100000:2.0:1789892571.175462:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:215139:x1876834925863040:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:2.0:1789892571.177124:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:215139:x1876834925863040:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1661us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892571.177132:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2809 00000100:00100000:3.0:1789892571.184150:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892571.184228:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863168 00000100:00100000:0.0:1789892571.184234:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863168 00000100:00100000:0.0:1789892571.184267:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2810 00000100:00100000:0.0:1789892571.184274:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:215140:x1876834925863168:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:0.0:1789892571.185811:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:215140:x1876834925863168:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1535us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892571.185819:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2810 00000100:00100000:1.0:1789892571.193583:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892571.193634:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863296 00000100:00100000:3.0:1789892571.193643:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863296 00000100:00100000:3.0:1789892571.193705:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2811 00000100:00100000:3.0:1789892571.193716:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:215141:x1876834925863296:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892571.195310:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:215141:x1876834925863296:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1595us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892571.195320:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2811 00000100:00100000:1.0:1789892571.201931:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892571.201981:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863424 00000100:00100000:0.0:1789892571.201987:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863424 00000100:00100000:0.0:1789892571.202021:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2812 00000100:00100000:0.0:1789892571.202028:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:215142:x1876834925863424:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:0.0:1789892571.203344:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:215142:x1876834925863424:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1315us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892571.203351:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2812 00010000:00010000:1.0:1789892571.938638:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892571.938648:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789892571.938716:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915959040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892571.938788:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892571.938828:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959040 00000100:00100000:1.0:1789892571.938836:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959040 00000100:00100000:1.0:1789892571.938880:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789892571.938890:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915959040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892571.938922:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892571.938975:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915959040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892571.938985:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789892571.939016:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915959040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892572.450699:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068825c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915959168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892572.450764:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.450799:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959168 00000100:00100000:1.0:1789892572.450807:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959168 00000100:00100000:1.0:1789892572.450876:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789892572.450889:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915959168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789892572.450923:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1789892572.450970:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915959168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.450976:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789892572.451014:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068825c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915959168:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789892572.738314:0:216870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 04:22:52 (1789892572) 00000100:00100000:1.0:1789892572.962603:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915959296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892572.962661:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915959680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892572.962735:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.962746:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068825c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915959552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892572.962780:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915960192:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.962788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892572.962824:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.962825:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915960064:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.962850:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959680 00000100:00100000:3.0:1789892572.962853:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915960704:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.962859:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959680 00000100:00100000:1.0:1789892572.962866:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892572.962898:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.962903:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915960576:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.962915:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959552 00000100:00100000:0.0:1789892572.962918:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959552 00000100:00100000:3.0:1789892572.962936:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915961216:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.962945:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892572.962950:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789892572.962962:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915959680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892572.962976:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.962981:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1876834915961088:0@lo:400:kworker.0 00002000:00000024:0.0:1789892572.962993:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892572.963022:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892572.963025:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789892572.963034:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915959808:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963050:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915959680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892572.963057:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789892572.963065:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789892572.963074:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.963077:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915959936:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963082:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789892572.963094:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915959552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789892572.963106:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892572.963109:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959808 00000100:00100000:2.0:1789892572.963115:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959808 00000100:00100000:3.0:1789892572.963120:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915960320:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892572.963151:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:2.0:1789892572.963163:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915959808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963167:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915959552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892572.963168:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.963176:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915960448:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963182:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789892572.963197:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915960832:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963222:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892572.963227:0:190944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960192 00000100:00100000:3.0:1789892572.963234:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892572.963234:0:190944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960192 00000100:00100000:2.0:1789892572.963235:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915959808:12345-0@lo:400:kworker.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892572.963249:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:1.0:1789892572.963253:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1876834915960960:0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.963271:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915961344:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963273:0:190944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960064 00000100:00100000:0.0:1789892572.963277:0:190944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960064 00000100:00100000:0.0:1789892572.963294:0:190944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960704 00000100:00100000:1.0:1789892572.963296:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892572.963297:0:190944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960704 00000100:00100000:0.0:1789892572.963320:0:190944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960576 00000100:00100000:0.0:1789892572.963322:0:190944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960576 00000100:00100000:3.0:1789892572.963328:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892572.963343:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789892572.963351:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915960192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963361:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068825c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915959552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892572.963375:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915959680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892572.963397:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915960192:12345-0@lo:400:kworker.0 Request processed in 46us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892572.963402:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915959808:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963415:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789892572.963416:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915961216 00000100:00100000:3.0:1789892572.963421:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915960192:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963423:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915961216 00000100:00100000:0.0:1789892572.963437:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789892572.963447:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915960064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963466:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915961088 00000100:00100000:1.0:1789892572.963471:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915961088 00000100:00100000:3.0:1789892572.963478:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789892572.963512:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915960704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963518:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906888f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915960064:12345-0@lo:400:kworker.0 Request processed in 47us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892572.963525:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789892572.963526:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960320 00000100:00100000:1.0:1789892572.963532:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960320 00000100:00100000:0.0:1789892572.963546:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789892572.963555:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915960576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963561:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960832 00000100:00100000:3.0:1789892572.963562:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915960704:12345-0@lo:400:kworker.0 Request processed in 73us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.963567:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960832 00000100:00100000:3.0:1789892572.963572:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789892572.963600:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960960 00000100:00100000:0.0:1789892572.963601:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915960576:12345-0@lo:400:kworker.0 Request processed in 47us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.963608:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960960 00000100:00080000:3.0:1789892572.963610:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892572.963614:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:3.0:1789892572.963618:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789892572.963623:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892572.963638:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915961344 00000100:00100000:1.0:1789892572.963661:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915961344 00000100:00100000:3.0:1789892572.963666:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1789892572.963676:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915961216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963691:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959936 00000100:00100000:0.0:1789892572.963697:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959936 00000100:00100000:1.0:1789892572.963708:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789892572.963718:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915961216:12345-0@lo:400:kworker.0 Request processed in 44us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.963725:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876834915961088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963729:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915960448 00000100:00100000:0.0:1789892572.963733:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915960448 00000100:00100000:3.0:1789892572.963742:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789892572.963757:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789892572.963770:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1789892572.963770:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915959936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.963785:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915960320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963788:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876834915961088:12345-0@lo:400:kworker.0 Request processed in 68us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.963797:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1789892572.963822:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915959936:12345-0@lo:400:kworker.0 Request processed in 57us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.963828:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1789892572.963833:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876834915960320:12345-0@lo:400:kworker.0 Request processed in 50us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892572.963837:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789892572.963844:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915960832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.963846:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1789892572.963856:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789892572.963866:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915960448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.963875:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1789892572.963889:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688243b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3620:x1876834915960960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.963902:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915960832:12345-0@lo:400:kworker.0 Request processed in 62us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892572.963909:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915960448:12345-0@lo:400:kworker.0 Request processed in 45us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892572.963916:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1789892572.963919:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789892572.963935:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688243b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3620:x1876834915960960:12345-0@lo:400:kworker.0 Request processed in 51us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892572.963941:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1789892572.963948:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1789892572.963962:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915961344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.963998:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915959936:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.964009:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915961344:12345-0@lo:400:kworker.0 Request processed in 50us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892572.964015:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915960448:0@lo:400:kworker.0 00000100:00100000:1.0:1789892572.964020:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00010000:00010000:3.0:1789892572.964025:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892572.964032:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1876834915960960:0@lo:400:kworker.0 00000100:00080000:3.0:1789892572.964033:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892572.964046:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915960064:0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.964054:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892572.964062:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915960576:0@lo:400:kworker.0 00010000:00080000:0.0:1789892572.964081:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906885316d80 x1876834915961088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892572.964087:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688da6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915959424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892572.964097:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876834915960320:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.964097:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1876834915961088:0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.964113:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892572.964135:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915960832:0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.964153:0:210708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959296 00010000:00080000:1.0:1789892572.964154:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906885317480 x1876834915961344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892572.964158:0:210708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959296 00000100:00100000:0.0:1789892572.964164:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915959424 00000100:00100000:1.0:1789892572.964168:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915961344:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.964170:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915959424 00000100:00100000:1.0:1789892572.964187:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915960704:0@lo:400:kworker.0 00000100:00100000:3.0:1789892572.964194:0:210708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789892572.964205:0:210708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915959296:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892572.964207:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915961216:0@lo:400:kworker.0 00000100:00100000:0.0:1789892572.964210:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789892572.964229:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915959424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789892572.964234:0:210708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789892572.964246:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892572.964278:0:210708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915959296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892572.964285:0:210708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789892572.964291:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915959424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892572.964297:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789892572.964324:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915959296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892572.964346:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688da6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915959424:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1789892573.827994:0:217045:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892573.828003:0:217045:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:3.0:1789892573.841571:0:217052:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789892573.841580:0:217052:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789892573.856698:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892573.856944:0:189439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863552 00000100:00100000:1.0:1789892573.856953:0:189439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863552 00000100:00100000:1.0:1789892573.857011:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2813 00000100:00100000:1.0:1789892573.857022:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:215436:x1876834925863552:12345-192.168.204.33@tcp:101:lfs.0 00010000:00010000:1.0:1789892573.857039:0:189439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789892573.857070:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789892573.857103:0:189439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800200/0x5c4f93dd0021397f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a699 expref: -99 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857158:0:189439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857169:0:189439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857179:0:189439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857191:0:189439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857196:0:189439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857209:0:189439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857248:0:189439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857256:0:189439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857265:0:189439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857272:0:189439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800e00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892573.857277:0:189439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857286:0:189439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857296:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42300) 00010000:00010000:1.0:1789892573.857299:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892573.857302:0:189439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857307:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800e00/0x5c4f93dd00213986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857316:0:189439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857321:0:189439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857331:0:189439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857335:0:189439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801600 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892573.857337:0:189439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857342:0:189439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857348:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff906983745800) 00010000:00010000:1.0:1789892573.857350:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892573.857352:0:189439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857356:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f801600/0x5c4f93dd0021398d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857381:0:189439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800200/0x5c4f93dd0021397f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a699 expref: 7 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857390:0:189439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42300) 00010000:00010000:1.0:1789892573.857392:0:189439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892573.857395:0:189439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688f800200/0x5c4f93dd0021397f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a699 expref: 7 pid: 189439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892573.857402:0:189439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800200, rc 0) 00000100:00100000:1.0:1789892573.857454:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+6:215436:x1876834925863552:12345-192.168.204.33@tcp:101:lfs.0 Request processed in 436us (763us total) trans 0 rc 301/301 00000100:00100000:1.0:1789892573.857468:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2813 00000100:00100000:1.0:1789892573.859515:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892573.859538:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863808 00000100:00100000:3.0:1789892573.859544:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863808 00000100:00100000:3.0:1789892573.859577:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2814 00000100:00100000:3.0:1789892573.859585:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:215436:x1876834925863808:12345-192.168.204.33@tcp:36:lfs.0 00010000:00010000:3.0:1789892573.859614:0:196796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892573.859643:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837200/0x5c4f93dd00213963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a68b expref: 6 pid: 189438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.859655:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42300) 00010000:00010000:3.0:1789892573.859665:0:196796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892573.859696:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.859704:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.859710:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.859718:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.859723:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.859728:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860175:0:196796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860184:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860190:0:196796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789892573.860200:0:196796:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000006ae11f9d reply state 00000000a5bcaeae transno 12884904341 ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860207:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860212:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff9069a9ade800) 00010000:00010000:3.0:1789892573.860214:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789892573.860216:0:196796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789892573.860219:0:196796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00010000:00010000:3.0:1789892573.860224:0:196796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860229:0:196796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860234:0:196796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860238:0:196796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f600 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:3.0:1789892573.860240:0:196796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860254:0:196796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860261:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069a9ade300) 00010000:00010000:3.0:1789892573.860262:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892573.860265:0:196796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860269:0:196796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878f600/0x5c4f93dd00213994 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789892573.860279:0:196796:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000006ae11f9d reply state 00000000a5bcaeae transno 12884904341 ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860285:0:196796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892573.860290:0:196796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff9069a9ade000) 00010000:00010000:3.0:1789892573.860291:0:196796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789892573.860293:0:196796:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789892573.860342:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+7:215436:x1876834925863808:12345-192.168.204.33@tcp:36:lfs.0 Request processed in 757us (828us total) trans 12884904341 rc 0/0 00000100:00100000:3.0:1789892573.860347:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2814 00000100:00100000:3.0:1789892573.864737:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892573.864784:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925863936 00000100:00100000:0.0:1789892573.864793:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925863936 00000100:00100000:0.0:1789892573.864853:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2815 00000100:00100000:0.0:1789892573.864866:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+7:215437:x1876834925863936:12345-192.168.204.33@tcp:101:chmod.0 00010000:00010000:0.0:1789892573.864882:0:191771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892573.864909:0:191771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd002139a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6a0 expref: -99 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.864956:0:191771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd002139b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.864964:0:191771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd002139b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.864972:0:191771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd002139b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892573.864997:0:191771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789892573.865000:0:191771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892573.865012:0:191771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd002139b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.865028:0:191771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836200/0x5c4f93dd002139a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6a0 expref: 9 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.865040:0:191771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836800/0x5c4f93dd002139b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6a0 expref: 8 pid: 191771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.865046:0:191771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42c00) 00010000:00010000:0.0:1789892573.865049:0:191771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892573.865051:0:191771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836800, rc 0) 00000100:00100000:0.0:1789892573.865089:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+8:215437:x1876834925863936:12345-192.168.204.33@tcp:101:chmod.0 Request processed in 227us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892573.865097:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2815 00000100:00100000:1.0:1789892573.865964:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892573.866031:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864064 00000100:00100000:0.0:1789892573.866044:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864064 00000100:00100000:0.0:1789892573.866083:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2816 00000100:00100000:0.0:1789892573.866092:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+8:215437:x1876834925864064:12345-192.168.204.33@tcp:101:chmod.0 00010000:00010000:0.0:1789892573.866100:0:189440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892573.866110:0:189440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837800/0x5c4f93dd002139b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6a7 expref: -99 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866141:0:189440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866148:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866155:0:189440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866163:0:189440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866167:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866172:0:189440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866217:0:189440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd002139cc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866223:0:189440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd002139cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866228:0:189440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd002139cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892573.866255:0:189440:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00000004:00200000:0.0:1789892573.866257:0:189440:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892573.866267:0:189440:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd002139cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866274:0:189440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866278:0:189440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866284:0:189440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866288:0:189440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836000 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:0.0:1789892573.866291:0:189440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866295:0:189440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866302:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9069b1c42c00) 00010000:00010000:0.0:1789892573.866304:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892573.866306:0:189440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866310:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836000/0x5c4f93dd002139be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866318:0:189440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866331:0:189440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866335:0:189440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866339:0:189440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836400 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:0.0:1789892573.866341:0:189440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866345:0:189440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866351:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff9069a9ade000) 00010000:00010000:0.0:1789892573.866352:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892573.866354:0:189440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866358:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836400/0x5c4f93dd002139c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866374:0:189440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837800/0x5c4f93dd002139b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6a7 expref: 10 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866383:0:189440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd002139cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6a7 expref: 9 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.866388:0:189440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff9069a9ade800) 00010000:00010000:0.0:1789892573.866389:0:189440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892573.866397:0:189440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892573.866429:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+9:215437:x1876834925864064:12345-192.168.204.33@tcp:101:chmod.0 Request processed in 339us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892573.866435:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2816 00000100:00100000:3.0:1789892573.867410:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892573.867481:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864320 00000100:00100000:0.0:1789892573.867486:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864320 00000100:00100000:0.0:1789892573.867724:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2817 00000100:00100000:0.0:1789892573.867734:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+9:215437:x1876834925864320:12345-192.168.204.33@tcp:36:chmod.0 00010000:00010000:0.0:1789892573.867759:0:191135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892573.867771:0:191135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990837600/0x5c4f93dd002139cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6a7 expref: 9 pid: 189440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.867781:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff9069a9ade800) 00010000:00010000:0.0:1789892573.867783:0:191135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892573.867794:0:191135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.867801:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.867807:0:191135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789892573.867893:0:191135:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000009293a9d6 reply state 000000006abb0646 transno 12884904342 ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.867901:0:191135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892573.867906:0:191135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff9069a9ade800) 00010000:00010000:0.0:1789892573.867915:0:191135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789892573.867917:0:191135:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789892573.867921:0:191135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00000100:00100000:0.0:1789892573.867965:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+10:215437:x1876834925864320:12345-192.168.204.33@tcp:36:chmod.0 Request processed in 232us (556us total) trans 12884904342 rc 0/0 00000100:00100000:0.0:1789892573.867972:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2817 00010000:00010000:0.0:1789892573.986718:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892574.657985:0:217158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc49837f60 20000000:00000080:1.0:1789892574.657999:0:217158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9069af800400 uarg=0000000000000000 20000000:01000000:1.0:1789892574.658033:0:217158:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789892574.658034:0:217158:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789892574.658036:0:217158:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=ugp' 20000000:01000000:1.0:1789892574.658041:0:217158:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'quota.ost=ugp' 20000000:01000000:1.0:1789892574.658045:0:217158:0:(mgs_llog.c:4246:mgs_write_log_quota()) global 'quota.ost=ugp' 20000000:01000000:1.0:1789892574.658092:0:217158:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789892574.658094:0:217158:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789892574.658337:0:217159:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 35 marker 169 1->4: lustre quota.ost 20000000:01000000:1.0:1789892574.658381:0:217159:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 169 2->4: lustre quota.ost 00000040:00080000:1.0:1789892574.658389:0:217159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 38 00000040:00080000:2.0:1789892574.658566:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14992 00000040:00080000:2.0:1789892574.658592:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 88 off15080 00000040:00080000:2.0:1789892574.658603:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 224 off15304 20000000:01000000:2.0:1789892574.658629:0:217158:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789892574.658630:0:217158:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892574.658810:0:217160:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 170 1->4: lustre quota.ost 20000000:01000000:2.0:1789892574.658834:0:217160:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 170 2->4: lustre quota.ost 00000040:00080000:2.0:1789892574.658848:0:217160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 41 count 41 00000040:00080000:1.0:1789892574.658948:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 224 off15520 00000040:00080000:1.0:1789892574.658963:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 88 off15608 00000040:00080000:1.0:1789892574.658973:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15832 20000000:01000000:1.0:1789892574.658980:0:217158:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789892574.658981:0:217158:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789892574.659142:0:217161:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 182 marker 171 1->4: lustre quota.ost 20000000:01000000:1.0:1789892574.659157:0:217161:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 184 marker 171 2->4: lustre quota.ost 00000040:00080000:1.0:1789892574.659168:0:217161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 215 count 211 00000040:00080000:2.0:1789892574.659247:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].215, 224 off47688 00000040:00080000:2.0:1789892574.659270:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].216, 88 off47776 00000040:00080000:2.0:1789892574.659280:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].217, 224 off48000 20000000:01000000:2.0:1789892574.659287:0:217158:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789892574.659288:0:217158:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892574.659440:0:217162:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 182 marker 172 1->4: lustre quota.ost 20000000:01000000:2.0:1789892574.659455:0:217162:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 184 marker 172 2->4: lustre quota.ost 00000040:00080000:2.0:1789892574.659465:0:217162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 215 count 211 00000040:00080000:1.0:1789892574.659560:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].215, 224 off47688 00000040:00080000:1.0:1789892574.659584:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].216, 88 off47776 00000040:00080000:1.0:1789892574.659601:0:217158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].217, 224 off48000 10000000:01000000:1.0:1789892574.659630:0:217158:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892574.659648:0:217158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659665:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659677:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659682:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659687:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659691:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659695:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659699:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659704:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659708:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659714:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659719:0:217158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659730:0:217158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659763:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659774:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 9 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.659786:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961472:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892574.659862:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659869:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 9 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.659876:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961600:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892574.659896:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659903:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 23 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.659910:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961728:0@lo:104: 00000100:00100000:1.0:1789892574.659940:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892574.659967:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.659982:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 23 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.659990:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961856:0@lo:104: 00000100:00100000:0.0:1789892574.659994:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915961728 00000100:00100000:0.0:1789892574.660003:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915961728 00000100:00100000:1.0:1789892574.660013:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892574.660037:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.660045:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 23 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660051:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961984:0@lo:104: 00000100:00100000:0.0:1789892574.660058:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00010000:00010000:1.0:1789892574.660069:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892574.660076:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915961728:12345-0@lo:104: 00010000:00010000:1.0:1789892574.660080:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 23 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.660082:0:193632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892574.660096:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915962112:0@lo:104: 00010000:00010000:0.0:1789892574.660098:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660108:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915961856 00000100:00100000:3.0:1789892574.660114:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915961856 00000100:00100000:2.0:1789892574.660119:0:193632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892574.660152:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915961984 00000100:00100000:3.0:1789892574.660156:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915961984 00000100:00100000:1.0:1789892574.660160:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1789892574.660172:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688b354050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217158:x1876834915961856:12345-0@lo:104: 00010000:00010000:1.0:1789892574.660179:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660181:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00010000:00010000:0.0:1789892574.660182:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892574.660196:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217158:x1876834915961728:12345-0@lo:104: Request processed in 125us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892574.660202:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217158:x1876834915961984:12345-0@lo:104: 00000100:00100000:0.0:1789892574.660210:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00010000:00010000:3.0:1789892574.660212:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.660239:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892574.660242:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892574.660251:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688b354050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217158:x1876834915961856:12345-0@lo:104: Request processed in 80us (233us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.660251:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660255:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892574.660262:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892574.660267:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660275:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217158:x1876834915961984:12345-0@lo:104: Request processed in 74us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.660276:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837400 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892574.660285:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660288:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00010000:00010000:2.0:1789892574.660297:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836e00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892574.660301:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00010000:0.0:1789892574.660307:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892574.660310:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892574.660327:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660329:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892574.660335:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660352:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789892574.660355:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789892574.660359:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892574.660386:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962112 00010000:00010000:2.0:1789892574.660388:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660390:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962112 00010000:00010000:0.0:1789892574.660396:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.660397:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660398:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892574.660416:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00010000:00010000:2.0:1789892574.660419:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660421:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892574.660426:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 23 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660428:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915962112:12345-0@lo:104: 00010000:00010000:0.0:1789892574.660437:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660439:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836e00/0x5c4f93dd002138f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138fa expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.660443:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660454:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915962496:0@lo:104: 00010000:00010000:0.0:1789892574.660468:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837400/0x5c4f93dd00213901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213908 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660470:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892574.660476:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660485:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e600 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892574.660508:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892574.660517:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789892574.660520:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660522:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892574.660531:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892574.660531:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660536:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892574.660539:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962496 00000100:00100000:3.0:1789892574.660544:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915962112:12345-0@lo:104: Request processed in 115us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.660546:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660547:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962496 00000100:00100000:3.0:1789892574.660562:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 10000000:00010000:2.0:1789892574.660571:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660573:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e200 already unused, calling callback (ffffffffc112ec20) 10000000:01000000:2.0:1789892574.660581:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892574.660581:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660587:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00010000:00010000:2.0:1789892574.660598:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660599:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660604:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915962496:12345-0@lo:104: 00010000:00010000:3.0:1789892574.660623:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892574.660634:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660635:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892574.660639:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915962240:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789892574.660639:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660656:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892574.660656:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892574.660669:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878e600/0x5c4f93dd002138e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138ec expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660682:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660683:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892574.660685:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892574.660688:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892574.660698:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892574.660709:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.660711:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915962624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.660724:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878e200/0x5c4f93dd002138d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138de expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660738:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892574.660742:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789892574.660746:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892574.660746:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1789892574.660749:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660755:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915962496:12345-0@lo:104: Request processed in 156us (264us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.660770:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:1.0:1789892574.660771:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 10000000:00010000:0.0:1789892574.660778:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660788:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660791:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:0.0:1789892574.660801:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660802:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915962368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892574.660809:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892574.660823:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892574.660827:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 23 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660839:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915962880:0@lo:104: 00000100:00100000:3.0:1789892574.660840:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892574.660848:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660858:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892574.660869:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.660878:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892574.660887:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915963008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892574.660888:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962240 00000100:00100000:2.0:1789892574.660894:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962240 00010000:00010000:0.0:1789892574.660903:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f200/0x5c4f93dd002138c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138d0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.660906:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.660923:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 24 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.660930:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 24 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.660933:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892574.660937:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892574.660944:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892574.660948:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915963136:0@lo:104: 00000100:00100000:2.0:1789892574.660966:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962368 00000100:00100000:2.0:1789892574.660972:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962368 00010000:00010000:0.0:1789892574.660977:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892574.660978:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892574.660991:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 25 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.660993:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892574.660997:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962880 00000100:00100000:0.0:1789892574.661006:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962880 00010000:00010000:1.0:1789892574.661007:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 25 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661017:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 25 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.661028:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915963264:0@lo:104: 00000100:00100000:2.0:1789892574.661029:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963008 00000100:00100000:2.0:1789892574.661040:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963008 00010000:00010000:3.0:1789892574.661043:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892574.661050:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963136 00000100:00100000:3.0:1789892574.661054:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915962752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.661058:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 26 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892574.661058:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963136 00000100:00100000:1.0:1789892574.661067:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892574.661093:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963264 00000100:00100000:2.0:1789892574.661097:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1789892574.661100:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892574.661100:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963264 00000100:00100000:1.0:1789892574.661112:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789892574.661113:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915962240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.661127:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892574.661127:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217158:x1876834915962880:12345-0@lo:104: 00010000:00010000:2.0:1789892574.661136:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 26 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.661137:0:189473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962752 00000100:00100000:0.0:1789892574.661137:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00010000:00010000:1.0:1789892574.661138:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.661144:0:189473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962752 00000100:00100000:0.0:1789892574.661157:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217158:x1876834915963136:12345-0@lo:104: 00010000:00010000:3.0:1789892574.661163:0:189473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 27 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.661166:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 27 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.661173:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661191:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892574.661192:0:189473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00010000:00010000:2.0:1789892574.661200:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892574.661200:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217158:x1876834915962880:12345-0@lo:104: Request processed in 77us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892574.661206:0:189473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3619:x1876834915962368:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892574.661213:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:3.0:1789892574.661217:0:189473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892574.661223:0:189473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 27 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.661234:0:189473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 27 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.661237:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00010000:00010000:0.0:1789892574.661250:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892574.661252:0:189473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892574.661253:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217158:x1876834915963264:12345-0@lo:104: 00000100:00100000:2.0:1789892574.661259:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+27:3619:x1876834915962240:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892574.661262:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217158:x1876834915963136:12345-0@lo:104: Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892574.661271:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00010000:00010000:1.0:1789892574.661279:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892574.661286:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1789892574.661287:0:189473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915962368:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892574.661295:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1789892574.661302:0:189473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1789892574.661307:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915963008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.661316:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892574.661321:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 25 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892574.661329:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00010000:00010000:2.0:1789892574.661331:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 25 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661332:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892574.661342:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915963264:12345-0@lo:104: Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892574.661345:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3622:x1876834915962752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.661351:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892574.661352:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00010000:00010000:0.0:1789892574.661362:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892574.661371:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 25 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661387:0:217158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 25 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661405:0:217158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 25 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.661413:0:217158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915963392:0@lo:104: 00010000:00010000:0.0:1789892574.661417:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 25 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661434:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3619:x1876834915963008:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (444us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.661435:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892574.661448:0:217158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892574.661458:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1789892574.661475:0:217158:0:(client.c:2702:ptlrpc_set_wait()) set ffff906982e41600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892574.661516:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961472:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892574.661524:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3622:x1876834915962752:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892574.661528:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961600:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892574.661543:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1789892574.661548:0:189423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892574.661550:0:217158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800000/0x5c4f93dd00213908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213901 expref: 24 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661560:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963392 00000100:00100000:2.0:1789892574.661565:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963392 00000100:00100000:1.0:1789892574.661567:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961728:0@lo:104: 00000100:00100000:3.0:1789892574.661584:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892574.661593:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915962752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892574.661597:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00010000:00010000:1.0:1789892574.661597:0:217158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff000/0x5c4f93dd002138fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002138f3 expref: 22 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661628:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068835acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915963392:12345-0@lo:104: 00000100:00100000:1.0:1789892574.661632:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961856:0@lo:104: 00000100:00100000:3.0:1789892574.661638:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:2.0:1789892574.661638:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.661647:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789892574.661654:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915961984:0@lo:104: 00010000:00010000:0.0:1789892574.661655:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.661667:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864448 00010000:00010000:0.0:1789892574.661671:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ec00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892574.661672:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864448 10000000:00010000:0.0:1789892574.661679:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661684:0:217158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffee00/0x5c4f93dd002138de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002138d7 expref: 21 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.661688:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789892574.661693:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 10 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.661699:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661701:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068835acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217158:x1876834915963392:12345-0@lo:104: Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892574.661707:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915962112:0@lo:104: 00000100:00100000:2.0:1789892574.661723:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 10000000:00010000:0.0:1789892574.661724:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661728:0:217158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801800/0x5c4f93dd002138d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002138c9 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.661736:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864576 00000100:00100000:3.0:1789892574.661741:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864576 10000000:01000000:0.0:1789892574.661746:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892574.661750:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915962496:0@lo:104: 00010000:00010000:3.0:1789892574.661764:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 11 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661769:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892574.661770:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915962880:0@lo:104: 00010000:00010000:0.0:1789892574.661782:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.661789:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915963136:0@lo:104: 00010000:00010000:0.0:1789892574.661797:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892574.661801:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915962624 00000100:00100000:3.0:1789892574.661805:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915962624 00000100:00100000:1.0:1789892574.661807:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883478a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915963264:0@lo:104: 00010000:00010000:0.0:1789892574.661818:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.661823:0:217158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217158:1876834915963392:0@lo:104: 00010000:00010000:3.0:1789892574.661824:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661841:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 574 00010000:00010000:0.0:1789892574.661852:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878ec00/0x5c4f93dd002138bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138c2 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.661855:0:217158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.661861:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925864448:12345-192.168.204.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789892574.661869:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 575 00010000:00010000:2.0:1789892574.661884:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892574.661886:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925864576:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.661888:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892574.661894:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 11 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.661896:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892574.661896:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.661905:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 11 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.661921:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837e00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:2.0:1789892574.661925:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 11 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892574.661928:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.661947:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 11 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.661947:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892574.661971:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.661978:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801a00/0x5c4f93dd0021390f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a66f expref: 11 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.661981:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878e000/0x5c4f93dd00213916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a676 expref: 11 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892574.661984:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892574.662003:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892574.662007:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892574.662010:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662021:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892574.662033:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2400:x1876834925864576:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 151us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892574.662040:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2399:x1876834925864448:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 184us (457us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.662043:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662045:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 575 00000100:00100000:2.0:1789892574.662059:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 574 00010000:00010000:0.0:1789892574.662060:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837e00/0x5c4f93dd002138ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138b4 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662068:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1789892574.662079:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3621:x1876834915962624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.662081:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892574.662087:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892574.662093:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662095:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662106:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f400 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892574.662113:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.662117:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662138:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.662139:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800a00/0x5c4f93dd002138ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002138e5 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.662164:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:0.0:1789892574.662164:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892574.662174:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892574.662194:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662201:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892574.662211:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662219:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f400/0x5c4f93dd0021389f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002138a6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662231:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915962624:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (467us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892574.662233:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789892574.662240:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00010000:00010000:0.0:1789892574.662240:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662251:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837c00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:0.0:1789892574.662255:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662275:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.662278:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789892574.662286:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892574.662293:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892574.662295:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915963008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892574.662307:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915962368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892574.662313:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915962240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.662319:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662324:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789892574.662331:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892574.662332:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915963520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.662345:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662356:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892574.662358:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837c00/0x5c4f93dd00213891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213898 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662378:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892574.662379:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915963904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.662384:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892574.662388:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963520 00010000:00010000:0.0:1789892574.662389:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892574.662393:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963520 00000100:00100000:3.0:1789892574.662402:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892574.662407:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892574.662412:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 19 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892574.662438:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915963648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892574.662439:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963904 00000100:00100000:2.0:1789892574.662443:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963904 00000100:00100000:1.0:1789892574.662448:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00010000:00010000:2.0:1789892574.662457:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892574.662460:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3619:x1876834915963520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892574.662474:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892574.662475:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892574.662483:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 20 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.662520:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1789892574.662526:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892574.662531:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069a9cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3619:x1876834915963904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.662538:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892574.662542:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662545:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915963776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.662555:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.662568:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801400/0x5c4f93dd00213898 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213891 expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662576:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892574.662580:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892574.662597:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915962624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892574.662626:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963648 00010000:00010000:1.0:1789892574.662629:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 19 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662631:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963648 00000100:00100000:2.0:1789892574.662641:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069a9cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:3619:x1876834915963904:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892574.662646:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffe400/0x5c4f93dd002138c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002138bb expref: 20 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892574.662650:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 20 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.662652:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1789892574.662656:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915963776 00010000:00010000:1.0:1789892574.662664:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892574.662664:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915963776 00000100:00100000:2.0:1789892574.662676:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00010000:00010000:0.0:1789892574.662688:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 19 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.662694:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915963648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892574.662706:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892574.662710:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915963904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892574.662711:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3619:x1876834915963520:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (353us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892574.662716:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 19 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892574.662727:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915963520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892574.662733:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00010000:00010000:2.0:1789892574.662745:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 19 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.662759:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800c00/0x5c4f93dd002138b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002138ad expref: 18 pid: 189433 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892574.662770:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892574.662771:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1789892574.662786:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3622:x1876834915963776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.662797:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892574.662804:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 17 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892574.662811:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3621:x1876834915963648:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892574.662822:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1789892574.662825:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915963648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892574.662827:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 17 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662845:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd002138a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd0021389f expref: 16 pid: 189432 timeout: 3499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662859:0:199151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662868:0:199151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662881:0:199151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662889:0:199151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662897:0:199151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662905:0:199151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662922:0:199151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f801000 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:0.0:1789892574.662927:0:199151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662935:0:199151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662956:0:199151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892574.662968:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892574.662972:0:217158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.662979:0:217158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892574.662984:0:217158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801000/0x5c4f93dd002139da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892574.663017:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915963776:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892574.663027:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1789892574.663036:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915963776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892575.010573:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892575.119290:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892575.119359:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1789892575.119371:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864832 00000100:00100000:2.0:1789892575.119385:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864832 00000100:00100000:1.0:1789892575.119385:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892575.119395:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864704 00000100:00100000:0.0:1789892575.119402:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864704 00000100:00100000:1.0:1789892575.119414:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925864960 00000100:00100000:1.0:1789892575.119419:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925864960 00000100:00100000:0.0:1789892575.119452:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2432 00000100:00100000:2.0:1789892575.119464:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 512 00000100:00100000:0.0:1789892575.119466:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925864704:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892575.119476:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 513 00000100:00100000:2.0:1789892575.119482:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+10:2400:x1876834925864832:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1789892575.119508:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925864960:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892575.119585:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2399:x1876834925864704:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 120us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892575.119595:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+5:2399:x1876834925864960:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892575.119636:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2432 00000100:00100000:2.0:1789892575.119642:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+10:2400:x1876834925864832:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 162us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892575.119642:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 513 00000100:00100000:2.0:1789892575.119657:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 512 00000100:00080000:2.0:1789892575.119689:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789892575.119694:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789892576.034641:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789892576.162593:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892576.162598:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 190 10000000:01000000:0.0:1789892576.162601:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892576.162641:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.162652:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.162669:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.162691:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.162747:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.162789:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892576.162831:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964032 00000100:00100000:1.0:1789892576.162838:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964032 00000100:00100000:1.0:1789892576.162879:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1789892576.162887:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915964032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892576.162898:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892576.162916:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002139e1 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.162936:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 16 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.162945:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 16 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.162951:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801200, rc 0) 00000100:00100000:1.0:1789892576.162989:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915964032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.162995:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:3.0:1789892576.163024:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892576.163040:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.163058:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.163128:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.163156:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.163183:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baaf0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.163189:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964160 00000100:00100000:0.0:1789892576.163194:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964160 00000100:00100000:0.0:1789892576.163227:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:0.0:1789892576.163232:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915964160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.163334:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915964160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.163340:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1789892576.163358:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.163388:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.163424:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.163441:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baaf0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.163455:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964288 00000100:00100000:0.0:1789892576.163460:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964288 00000100:00100000:0.0:1789892576.163485:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:0.0:1789892576.163516:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915964288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.163602:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915964288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.163608:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00100000:3.0:1789892576.163627:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892576.164226:0:217374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789892576.164287:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789892576.164314:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892576.164320:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.164332:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892576.164338:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892576.164340:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892576.164342:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892576.164356:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.164361:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.164367:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.164377:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.164401:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.164436:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906998ebc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.164436:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964416 00000100:00100000:0.0:1789892576.164441:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964416 00000100:00100000:0.0:1789892576.164466:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436 00000100:00100000:0.0:1789892576.164472:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915964416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.164485:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892576.164516:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002139ef expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.164528:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 17 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.164534:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 17 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.164539:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892576.164574:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915964416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.164594:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436 00000100:00100000:1.0:1789892576.164613:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892576.164626:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.164634:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.164671:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892576.164694:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.164719:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964544 00000100:00100000:1.0:1789892576.164721:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069838a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.164723:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964544 00000100:00100000:0.0:1789892576.164745:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:0.0:1789892576.164750:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915964544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.164805:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915964544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.164810:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:1.0:1789892576.164828:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892576.164849:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892576.164878:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892576.164891:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069838a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.164895:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964672 00000100:00100000:0.0:1789892576.164900:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964672 00000100:00100000:0.0:1789892576.164916:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:0.0:1789892576.164921:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915964672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.164977:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915964672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.164990:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1789892576.164993:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915964672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892576.165165:0:217375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217375:1876834915964800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892576.165200:0:217375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892576.165212:0:217375:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a3bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.165227:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964800 00000100:00100000:0.0:1789892576.165231:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964800 00000100:00100000:0.0:1789892576.165250:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:0.0:1789892576.165255:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:217375:x1876834915964800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.165316:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:217375:x1876834915964800:12345-0@lo:502:llog_process_th.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.165322:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1789892576.165324:0:217375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217375:1876834915964800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892576.165350:0:217375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892576.165357:0:217375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892576.165359:0:217375:0:(obd_config.c:1561:class_process_config()) marker 203 (0x1) lustre quota.ost 00000020:00000080:1.0:1789892576.165363:0:217375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789892576.165378:0:217375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217375:1876834915964928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892576.165403:0:217375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892576.165416:0:217375:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a3bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.165421:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915964928 00000100:00100000:0.0:1789892576.165425:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915964928 00000100:00100000:0.0:1789892576.165444:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:0.0:1789892576.165449:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:217375:x1876834915964928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892576.165528:0:217375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217375:1876834915964928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.165533:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:217375:x1876834915964928:12345-0@lo:502:llog_process_th.0 Request processed in 82us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.165541:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000020:01000000:1.0:1789892576.165550:0:217375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892576.165554:0:217375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892576.165555:0:217375:0:(obd_config.c:1561:class_process_config()) marker 203 (0x2) lustre quota.ost 00000040:00080000:1.0:1789892576.165559:0:217375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 41 00000020:01000000:3.0:1789892576.165637:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-40 (rc=0) 10000000:01000000:3.0:1789892576.165657:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892576.165663:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.165672:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892576.165680:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892576.165682:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 190 10000000:01000000:3.0:1789892576.165684:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892576.165708:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.165716:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.165725:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.165739:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.165767:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.165798:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906998ebc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.165799:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965056 00000100:00100000:0.0:1789892576.165804:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965056 00000100:00100000:0.0:1789892576.165825:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441 00000100:00100000:0.0:1789892576.165829:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915965056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.165834:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892576.165840:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd002139fd expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.165851:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.165857:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.165867:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892576.165891:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915965056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.165895:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441 00000100:00100000:3.0:1789892576.165925:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892576.165938:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.165947:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.165986:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.166014:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.166036:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906998ebc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.166044:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965184 00000100:00100000:0.0:1789892576.166048:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965184 00000100:00100000:0.0:1789892576.166066:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:0.0:1789892576.166070:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915965184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.166117:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915965184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.166122:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:3.0:1789892576.166144:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.166180:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.166217:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.166237:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965312 00000100:00100000:3.0:1789892576.166240:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906998ebc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.166240:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965312 00000100:00100000:0.0:1789892576.166262:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1789892576.166266:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915965312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.166316:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915965312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 48us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.166321:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:3.0:1789892576.166340:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892576.166928:0:217376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789892576.166983:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789892576.167000:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892576.167006:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.167015:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892576.167020:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892576.167021:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789892576.167023:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892576.167034:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.167039:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.167046:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.167059:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.167088:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.167108:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965440 00000100:00100000:0.0:1789892576.167113:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965440 00000100:00100000:3.0:1789892576.167118:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.167136:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1789892576.167141:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915965440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.167147:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892576.167153:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a0b expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.167169:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 19 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.167175:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 19 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.167180:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837800, rc 0) 00000100:00100000:0.0:1789892576.167205:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915965440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.167209:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1789892576.167253:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892576.167266:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.167276:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.167330:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.167360:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.167379:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965568 00000100:00100000:0.0:1789892576.167383:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965568 00000100:00100000:3.0:1789892576.167384:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.167407:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1789892576.167415:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915965568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.167476:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915965568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.167482:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:3.0:1789892576.167548:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.167609:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.167652:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.167674:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965696 00000100:00100000:0.0:1789892576.167678:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965696 00000100:00100000:3.0:1789892576.167698:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.167715:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:0.0:1789892576.167726:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915965696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.167789:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915965696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.167795:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:3.0:1789892576.167819:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915965696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.168017:0:217377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217377:1876834915965824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.168060:0:217377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.168075:0:217377:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892576.168083:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965824 00000100:00100000:1.0:1789892576.168088:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965824 00000100:00100000:1.0:1789892576.168117:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:1.0:1789892576.168124:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:217377:x1876834915965824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892576.168203:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:217377:x1876834915965824:12345-0@lo:502:llog_process_th.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.168212:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:0.0:1789892576.168212:0:217377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217377:1876834915965824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892576.168239:0:217377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892576.168245:0:217377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892576.168246:0:217377:0:(obd_config.c:1561:class_process_config()) marker 204 (0x1) lustre quota.ost 00000020:00000080:0.0:1789892576.168250:0:217377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789892576.168269:0:217377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217377:1876834915965952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.168302:0:217377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.168315:0:217377:0:(client.c:2702:ptlrpc_set_wait()) set ffff90698622fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892576.168329:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915965952 00000100:00100000:1.0:1789892576.168335:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915965952 00000100:00100000:1.0:1789892576.168379:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448 00000100:00100000:1.0:1789892576.168388:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:217377:x1876834915965952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892576.168480:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:217377:x1876834915965952:12345-0@lo:502:llog_process_th.0 Request processed in 91us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.168482:0:217377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217377:1876834915965952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892576.168523:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448 00000020:01000000:0.0:1789892576.168525:0:217377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892576.168530:0:217377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892576.168531:0:217377:0:(obd_config.c:1561:class_process_config()) marker 204 (0x2) lustre quota.ost 00000040:00080000:0.0:1789892576.168535:0:217377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 44 count 44 00000020:01000000:3.0:1789892576.168597:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-43 (rc=0) 10000000:01000000:3.0:1789892576.168615:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892576.168620:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.168627:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892576.168633:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892576.168635:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 190 10000000:01000000:3.0:1789892576.168637:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892576.168653:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.168658:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.168664:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.168684:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.168713:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.168740:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892576.168744:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966080 00000100:00100000:1.0:1789892576.168750:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966080 00000100:00100000:1.0:1789892576.168791:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1789892576.168801:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915966080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892576.168809:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892576.168820:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a19 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.168839:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.168850:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.168858:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801e00, rc 0) 00000100:00100000:1.0:1789892576.168901:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915966080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.168909:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:3.0:1789892576.168924:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892576.168934:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.168941:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.168975:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.168995:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.169012:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.169031:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966208 00000100:00100000:0.0:1789892576.169037:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966208 00000100:00100000:0.0:1789892576.169066:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:0.0:1789892576.169071:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915966208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.169128:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915966208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.169133:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:3.0:1789892576.169158:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.169178:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892576.169209:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.169230:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.169231:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966336 00000100:00100000:0.0:1789892576.169236:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966336 00000100:00100000:0.0:1789892576.169260:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1789892576.169267:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915966336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.169321:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915966336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.169333:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:3.0:1789892576.169340:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892576.169978:0:217379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:0.0:1789892576.170037:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:0.0:1789892576.170065:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892576.170070:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.170078:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892576.170084:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789892576.170086:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 215 10000000:01000000:0.0:1789892576.170088:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892576.170101:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.170107:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.170112:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.170122:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.170149:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.170181:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.170195:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966464 00000100:00100000:2.0:1789892576.170203:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966464 00000100:00100000:2.0:1789892576.170246:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:2.0:1789892576.170258:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915966464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892576.170277:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892576.170288:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a27 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.170305:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 21 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.170316:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 21 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.170325:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fff000, rc 0) 00000100:00100000:2.0:1789892576.170373:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915966464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.170377:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.170386:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00010000:00010000:0.0:1789892576.170393:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.170410:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.170447:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.170473:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.170528:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.170534:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966592 00000100:00100000:2.0:1789892576.170540:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966592 00000100:00100000:2.0:1789892576.170573:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453 00000100:00100000:2.0:1789892576.170595:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915966592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.170675:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915966592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.170684:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453 00000100:00100000:0.0:1789892576.170689:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.170721:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.170753:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.170769:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df000 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.170788:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966720 00000100:00100000:2.0:1789892576.170794:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966720 00000100:00100000:2.0:1789892576.170823:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:2.0:1789892576.170832:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915966720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.170918:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915966720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.170927:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915966720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.170940:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:2.0:1789892576.171121:0:217380:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217380:1876834915966848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892576.171164:0:217380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.171186:0:217380:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.171191:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966848 00000100:00100000:0.0:1789892576.171198:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966848 00000100:00100000:0.0:1789892576.171232:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:0.0:1789892576.171241:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217380:x1876834915966848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.171330:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217380:x1876834915966848:12345-0@lo:502:llog_process_th.0 Request processed in 91us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.171335:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1789892576.171365:0:217380:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217380:1876834915966848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892576.171389:0:217380:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892576.171395:0:217380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892576.171398:0:217380:0:(obd_config.c:1561:class_process_config()) marker 205 (0x1) lustre quota.ost 00000020:00000080:2.0:1789892576.171404:0:217380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789892576.171425:0:217380:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217380:1876834915966976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892576.171470:0:217380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.171543:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915966976 00000100:00100000:0.0:1789892576.171546:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915966976 00000100:00100000:0.0:1789892576.171590:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:0.0:1789892576.171598:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217380:x1876834915966976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.171702:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217380:x1876834915966976:12345-0@lo:502:llog_process_th.0 Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.171703:0:217380:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069baab5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.171721:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:2.0:1789892576.171725:0:217380:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217380:1876834915966976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892576.171751:0:217380:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892576.171757:0:217380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892576.171759:0:217380:0:(obd_config.c:1561:class_process_config()) marker 205 (0x2) lustre quota.ost 00000040:00080000:2.0:1789892576.171763:0:217380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 218 count 214 00000020:01000000:0.0:1789892576.171817:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 215-217 (rc=0) 10000000:01000000:0.0:1789892576.171839:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892576.171846:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.171856:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892576.171865:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892576.171866:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 190 10000000:01000000:0.0:1789892576.171868:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892576.171880:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.171885:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.171891:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.171900:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.171921:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.171934:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.171950:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967104 00000100:00100000:2.0:1789892576.171956:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967104 00000100:00100000:2.0:1789892576.171992:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:2.0:1789892576.172002:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915967104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892576.172010:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892576.172021:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a35 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.172040:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.172060:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 22 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.172069:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884ffea00, rc 0) 00000100:00100000:2.0:1789892576.172111:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915967104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.172118:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:0.0:1789892576.172120:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.172133:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.172148:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.172178:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.172197:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.172210:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.172222:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967232 00000100:00100000:2.0:1789892576.172227:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967232 00000100:00100000:2.0:1789892576.172254:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1789892576.172263:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915967232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.172346:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915967232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.172353:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.172358:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:0.0:1789892576.172374:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.172403:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.172415:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.172425:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967360 00000100:00100000:2.0:1789892576.172431:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967360 00000100:00100000:2.0:1789892576.172459:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:2.0:1789892576.172467:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915967360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.172591:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915967360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.172598:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.172604:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000040:00080000:2.0:1789892576.173272:0:217381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:0.0:1789892576.173317:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:0.0:1789892576.173338:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892576.173343:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.173349:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892576.173354:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892576.173355:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 215 10000000:01000000:0.0:1789892576.173357:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892576.173370:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.173375:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.173386:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.173397:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.173423:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.173458:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967488 00000100:00100000:2.0:1789892576.173462:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967488 00000100:00100000:0.0:1789892576.173464:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.173534:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1789892576.173541:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915967488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892576.173553:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892576.173561:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a43 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.173575:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.173598:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.173603:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906884fffa00, rc 0) 00000100:00100000:2.0:1789892576.173638:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915967488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.173644:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:0.0:1789892576.173674:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.173688:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.173697:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.173743:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.173775:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.173795:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967616 00000100:00100000:2.0:1789892576.173799:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967616 00000100:00100000:0.0:1789892576.173810:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.173825:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1789892576.173830:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915967616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.173904:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915967616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.173913:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1789892576.173924:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.173955:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.174001:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.174022:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967744 00000100:00100000:0.0:1789892576.174024:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892576.174026:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967744 00000100:00100000:2.0:1789892576.174050:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1789892576.174055:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915967744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.174117:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915967744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.174131:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1789892576.174140:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915967744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892576.174315:0:217382:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217382:1876834915967872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892576.174346:0:217382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.174363:0:217382:0:(client.c:2702:ptlrpc_set_wait()) set ffff906881b8ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.174375:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915967872 00000100:00100000:0.0:1789892576.174381:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915967872 00000100:00100000:0.0:1789892576.174410:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:0.0:1789892576.174419:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217382:x1876834915967872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.174629:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217382:x1876834915967872:12345-0@lo:502:llog_process_th.0 Request processed in 210us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.174639:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:3.0:1789892576.174667:0:217382:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217382:1876834915967872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892576.174703:0:217382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892576.174716:0:217382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892576.174719:0:217382:0:(obd_config.c:1561:class_process_config()) marker 206 (0x1) lustre quota.ost 00000020:00000080:3.0:1789892576.174725:0:217382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789892576.174757:0:217382:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217382:1876834915968000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892576.174801:0:217382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.174837:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968000 00000100:00100000:0.0:1789892576.174843:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968000 00000100:00100000:3.0:1789892576.174844:0:217382:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892576.174881:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1789892576.174892:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217382:x1876834915968000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892576.174975:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217382:x1876834915968000:12345-0@lo:502:llog_process_th.0 Request processed in 85us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.174985:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:3.0:1789892576.174992:0:217382:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217382:1876834915968000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892576.175018:0:217382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892576.175023:0:217382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892576.175024:0:217382:0:(obd_config.c:1561:class_process_config()) marker 206 (0x2) lustre quota.ost 00000040:00080000:3.0:1789892576.175027:0:217382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 218 count 214 00000020:01000000:0.0:1789892576.175076:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 215-217 (rc=0) 10000000:01000000:0.0:1789892576.175101:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789892576.175109:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.175118:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892576.175127:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789892576.175130:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:0.0:1789892576.175132:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789892576.175148:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.175157:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.175165:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.175187:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915968128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.175217:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.175239:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892576.175255:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968128 00000100:00100000:1.0:1789892576.175260:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968128 00000100:00100000:1.0:1789892576.175286:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:1.0:1789892576.175293:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915968128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892576.175300:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892576.175313:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a51 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.175326:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.175333:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.175338:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800800, rc 0) 00000100:00100000:1.0:1789892576.175370:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915968128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.175375:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1789892576.175396:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915968128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.175410:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.175421:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.175467:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915968256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.175529:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892576.175555:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968256 00000100:00100000:1.0:1789892576.175559:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968256 00000100:00100000:0.0:1789892576.175592:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068824df180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892576.175603:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1789892576.175611:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915968256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892576.175662:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915968256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892576.175669:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:0.0:1789892576.175685:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915968256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789892576.175706:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789892576.175710:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.175715:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.207241:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892576.207284:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865088 00000100:00100000:0.0:1789892576.207294:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865088 00000100:00100000:0.0:1789892576.207345:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2467 00000100:00100000:0.0:1789892576.207355:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925865088:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.207378:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892576.207393:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6ae expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.207417:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.207426:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.207433:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892576.207638:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925865088:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 134us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.207649:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2467 00000100:00100000:3.0:1789892576.208312:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892576.208346:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865216 00000100:00100000:0.0:1789892576.208350:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865216 00000100:00100000:0.0:1789892576.208382:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2468 00000100:00100000:0.0:1789892576.208391:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925865216:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.208531:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925865216:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 138us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.208542:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2468 00000100:00100000:3.0:1789892576.209101:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892576.209133:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865344 00000100:00100000:0.0:1789892576.209137:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865344 00000100:00100000:0.0:1789892576.209164:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2469 00000100:00100000:0.0:1789892576.209171:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925865344:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.209241:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925865344:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.209253:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2469 00000100:00100000:3.0:1789892576.210667:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892576.210698:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865472 00000100:00100000:0.0:1789892576.210703:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865472 00000100:00100000:0.0:1789892576.210728:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2470 00000100:00100000:0.0:1789892576.210734:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925865472:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892576.210740:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892576.210749:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6b5 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.210762:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.210770:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 10 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.210776:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837c00, rc 0) 00000100:00100000:0.0:1789892576.210800:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925865472:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.210805:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2470 00000100:00100000:3.0:1789892576.211371:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892576.211403:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865600 00000100:00100000:0.0:1789892576.211407:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865600 00000100:00100000:0.0:1789892576.211432:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2471 00000100:00100000:0.0:1789892576.211440:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925865600:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892576.211518:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925865600:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 51us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892576.211527:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2471 00000001:02000400:1.0:1789892576.303718:0:217410:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: User quota (block hardlimit:50 MB) 00000100:00100000:3.0:1789892576.319748:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892576.319789:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865728 00000100:00100000:1.0:1789892576.319802:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865728 00000100:00100000:1.0:1789892576.319850:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2818 00000100:00100000:1.0:1789892576.319861:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+10:215715:x1876834925865728:12345-192.168.204.33@tcp:48:lfs.0 00000001:00080000:2.0:1789892576.320918:0:189419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904342 is committed 00010000:00010000:1.0:1789892576.320943:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.320953:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.320966:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.320973:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878fa00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892576.320977:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.320984:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321002:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff9069a9ade000) 00010000:00010000:1.0:1789892576.321006:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892576.321012:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321021:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878fa00/0x5c4f93dd0021399b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321049:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321056:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321061:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321066:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e800 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892576.321069:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321083:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321095:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff9069a9ade800) 00010000:00010000:1.0:1789892576.321099:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892576.321103:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321111:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90688878e800/0x5c4f93dd002139a2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321131:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321136:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321141:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321145:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836c00 already unused, calling callback (ffffffffc174d6d0) 00010000:00010000:1.0:1789892576.321147:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321152:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321159:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff9069a9ade800) 00010000:00010000:1.0:1789892576.321161:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789892576.321163:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.321176:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff906990836c00/0x5c4f93dd002139d3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191135 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.321779:0:196796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906882601500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968384:0@lo:106: 00000100:00100000:3.0:1789892576.321831:0:196796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.321865:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968384 00000100:00100000:2.0:1789892576.321871:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968384 00000100:00100000:3.0:1789892576.321889:0:196796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068825c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968512:0@lo:106: 00000100:00100000:3.0:1789892576.321913:0:196796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892576.321920:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1789892576.321933:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:196796:x1876834915968384:12345-0@lo:106: 00000100:00100000:1.0:1789892576.321935:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968512 00000100:00100000:1.0:1789892576.321942:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968512 00000100:00100000:3.0:1789892576.321945:0:196796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068825c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968640:0@lo:106: 00010000:00010000:2.0:1789892576.321948:0:193632:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.321961:0:193632:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff90688d5e6e00/0x5c4f93dd0020e7ee lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e7fc expref: -99 pid: 191773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.321972:0:196796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892576.321985:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968640 00000100:00100000:1.0:1789892576.321989:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968640 00000100:00100000:3.0:1789892576.322000:0:196796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968768:0@lo:106: 00000100:00100000:1.0:1789892576.322010:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789892576.322022:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:196796:x1876834915968512:12345-0@lo:106: 00000100:00100000:3.0:1789892576.322032:0:196796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892576.322043:0:189423:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.322044:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:196796:x1876834915968384:12345-0@lo:106: Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892576.322046:0:196796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069990eda80 going to sleep for 11 seconds 00010000:00010000:1.0:1789892576.322063:0:189423:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90688a3e3a00/0x5c4f93dd0020e643 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e666 expref: -99 pid: 190967 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.322064:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789892576.322070:0:196796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906882601500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968384:0@lo:106: 00000100:00100000:2.0:1789892576.322092:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915968768 00000100:00100000:2.0:1789892576.322098:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915968768 00000100:00100000:3.0:1789892576.322103:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789892576.322112:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0001+9:196796:x1876834915968640:12345-0@lo:106: 00000100:00100000:2.0:1789892576.322127:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00010000:00010000:3.0:1789892576.322128:0:189472:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.322138:0:189472:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff906886581e00/0x5c4f93dd0020e555 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e563 expref: -99 pid: 190192 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.322144:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:196796:x1876834915968768:12345-0@lo:106: 00000100:00100000:1.0:1789892576.322144:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:196796:x1876834915968512:12345-0@lo:106: Request processed in 122us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.322160:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00010000:00010000:2.0:1789892576.322163:0:193632:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.322172:0:193632:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9069c2045600/0x5c4f93dd0020e428 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd0020e4e5 expref: -99 pid: 189475 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.322191:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0001+9:196796:x1876834915968640:12345-0@lo:106: Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892576.322198:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1789892576.322236:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:196796:x1876834915968768:12345-0@lo:106: Request processed in 99us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.322243:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789892576.322597:0:196796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068825c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968512:0@lo:106: 00000100:00100000:3.0:1789892576.322617:0:196796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068825c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968640:0@lo:106: 00000100:00100000:3.0:1789892576.322629:0:196796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:196796:1876834915968768:0@lo:106: 00000100:00100000:3.0:1789892576.322759:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:082b2a23-8951-488c-926f-5ad884776d61+6:215715:x1876834925865728:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 2899us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892576.322770:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2818 00000020:00000080:0.0:1789892576.613255:0:217458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff1e9f53c0 20000000:00000080:0.0:1789892576.613268:0:217458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9069baacc000 uarg=0000000000000000 00000040:00100000:0.0:1789892576.613870:0:217458:0:(llog.c:1072:llog_reverse_process()) index 189 : idx 181 20000000:01000000:0.0:1789892576.613878:0:217458:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 182 cmd:0xce023 lustre.qpool1 00000040:00080000:0.0:1789892576.613960:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].190, 224 off42864 20000000:01000000:0.0:1789892576.613978:0:217458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892576.613995:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].191, 104 off42968 00000040:00080000:0.0:1789892576.614023:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].192, 224 off43192 00000040:00080000:0.0:1789892576.614083:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].218, 224 off48224 20000000:01000000:0.0:1789892576.614092:0:217458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892576.614107:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].219, 112 off48336 00000040:00080000:0.0:1789892576.614124:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].220, 224 off48560 00000040:00080000:0.0:1789892576.614183:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].218, 224 off48224 20000000:01000000:0.0:1789892576.614192:0:217458:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892576.614207:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].219, 112 off48336 00000040:00080000:0.0:1789892576.614222:0:217458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].220, 224 off48560 10000000:01000000:0.0:1789892576.614232:0:217458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892576.614251:0:217458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614268:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614277:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614285:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614292:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614310:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614317:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614323:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614330:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614338:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614347:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614355:0:217458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614363:0:217458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614400:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 9 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614414:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 9 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.614438:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915968896:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892576.614553:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614563:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 9 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.614588:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969024:192.168.204.33@tcp:104: 00010000:00010000:0.0:1789892576.614625:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614634:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 23 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.614645:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969152:0@lo:104: 00000100:00100000:0.0:1789892576.614684:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892576.614717:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.614727:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.614737:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969280:0@lo:104: 00000100:00100000:1.0:1789892576.614740:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969152 00000100:00100000:1.0:1789892576.614751:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969152 00000100:00100000:0.0:1789892576.614767:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892576.614799:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.614812:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969280 00000100:00100000:1.0:1789892576.614817:0:189423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789892576.614821:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 23 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.614822:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969280 00000100:00100000:1.0:1789892576.614837:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1789892576.614838:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969408:0@lo:104: 00000100:00100000:3.0:1789892576.614849:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1789892576.614855:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217458:x1876834915969152:12345-0@lo:104: 00000100:00100000:3.0:1789892576.614866:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217458:x1876834915969280:12345-0@lo:104: 00010000:00010000:1.0:1789892576.614870:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.614879:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.614880:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892576.614917:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.614921:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969408 00000100:00100000:2.0:1789892576.614928:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969408 00010000:00010000:0.0:1789892576.614933:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 23 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.614945:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969536:0@lo:104: 00010000:00010000:1.0:1789892576.614958:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892576.614964:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1789892576.614972:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217458:x1876834915969152:12345-0@lo:104: Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.614978:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217458:x1876834915969408:12345-0@lo:104: 00000100:00100000:1.0:1789892576.614992:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00010000:00010000:2.0:1789892576.614995:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615017:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892576.615023:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.615035:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892576.615044:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836600 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892576.615045:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.615051:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217458:x1876834915969280:12345-0@lo:104: Request processed in 187us (279us total) trans 0 rc 0/0 10000000:00010000:1.0:1789892576.615053:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615065:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892576.615068:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:1.0:1789892576.615071:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.615073:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217458:x1876834915969408:12345-0@lo:104: Request processed in 99us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892576.615090:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00010000:00010000:0.0:1789892576.615090:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892576.615092:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615104:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969536 00000100:00100000:3.0:1789892576.615110:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969536 00010000:00010000:2.0:1789892576.615112:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:1.0:1789892576.615114:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892576.615116:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 23 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615121:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615138:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836200 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892576.615140:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969664:0@lo:104: 10000000:00010000:2.0:1789892576.615144:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615149:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00010000:00010000:2.0:1789892576.615155:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615160:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217458:x1876834915969536:12345-0@lo:104: 00010000:00010000:1.0:1789892576.615163:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892576.615164:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.615169:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615177:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892576.615184:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789892576.615185:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892576.615218:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615222:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.615231:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892576.615231:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615236:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836600/0x5c4f93dd00213a51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a58 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615243:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217458:x1876834915969536:12345-0@lo:104: Request processed in 84us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892576.615244:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892576.615259:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 23 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615263:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00010000:00010000:2.0:1789892576.615266:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615267:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892576.615275:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615275:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970048:0@lo:104: 00000100:00100000:3.0:1789892576.615282:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969664 00010000:00010000:2.0:1789892576.615282:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836200/0x5c4f93dd00213a43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a4a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615287:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969664 00010000:00010000:2.0:1789892576.615303:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892576.615310:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615315:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00010000:00010000:1.0:1789892576.615315:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836000 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892576.615323:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892576.615324:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615325:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990836400 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892576.615330:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217458:x1876834915969664:12345-0@lo:104: 10000000:00010000:2.0:1789892576.615331:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.615342:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.615346:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615347:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615349:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.615374:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 23 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892576.615376:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892576.615377:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.615386:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892576.615389:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970176:0@lo:104: 00000100:00100000:3.0:1789892576.615401:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217458:x1876834915969664:12345-0@lo:104: Request processed in 70us (215us total) trans 0 rc 0/0 10000000:01000000:2.0:1789892576.615401:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789892576.615403:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892576.615425:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892576.615435:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615442:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615444:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892576.615451:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892576.615456:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615463:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615465:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.615466:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 23 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615480:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1789892576.615513:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970560:0@lo:104: 00010000:00010000:2.0:1789892576.615514:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836400/0x5c4f93dd00213a27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a2e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.615524:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990836000/0x5c4f93dd00213a35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a3c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615525:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970048 00010000:00010000:2.0:1789892576.615531:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789892576.615532:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970048 00010000:00010000:2.0:1789892576.615538:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615539:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892576.615540:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892576.615545:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892576.615551:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892576.615552:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878fe00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:3.0:1789892576.615557:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970176 10000000:00010000:2.0:1789892576.615557:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615559:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970176 00010000:00010000:2.0:1789892576.615566:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.615579:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915969792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892576.615593:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970560 10000000:00010000:2.0:1789892576.615593:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615597:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970560 10000000:01000000:2.0:1789892576.615600:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892576.615600:0:217458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 23 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.615616:0:217458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 23 pid: 189432 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615618:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1789892576.615625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.615633:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217458:x1876834915970048:12345-0@lo:104: 00010000:00010000:2.0:1789892576.615634:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615635:0:217458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970688:0@lo:104: 00010000:00010000:3.0:1789892576.615645:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615647:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892576.615659:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615666:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878fe00/0x5c4f93dd00213a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a20 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.615670:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915970816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892576.615693:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892576.615698:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892576.615699:0:217458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892576.615703:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892576.615709:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:2.0:1789892576.615710:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.615717:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878ea00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892576.615719:0:217458:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892576.615720:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217458:x1876834915970048:12345-0@lo:104: Request processed in 86us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.615722:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789892576.615724:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615732:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:2.0:1789892576.615735:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615743:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969152:0@lo:104: 10000000:00010000:2.0:1789892576.615744:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.615753:0:189472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:01000000:2.0:1789892576.615754:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892576.615761:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789892576.615761:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969280:0@lo:104: 00000100:00100000:3.0:1789892576.615764:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970688 00000100:00100000:3.0:1789892576.615771:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970688 00000100:00100000:1.0:1789892576.615773:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915970432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892576.615787:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615790:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969408:0@lo:104: 00010000:00010000:2.0:1789892576.615796:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892576.615802:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892576.615808:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615816:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885315f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969536:0@lo:104: 00010000:00010000:2.0:1789892576.615822:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878ea00/0x5c4f93dd00213a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a12 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615831:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969664:0@lo:104: 00000100:00100000:1.0:1789892576.615835:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915969920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892576.615839:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892576.615844:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892576.615845:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970048:0@lo:104: 00010000:00010000:2.0:1789892576.615857:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892576.615858:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1789892576.615864:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892576.615873:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217458:x1876834915970176:12345-0@lo:104: 00000100:00100000:2.0:1789892576.615873:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915970304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.615884:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.615886:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915970944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892576.615888:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969792 00000100:00100000:0.0:1789892576.615895:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969792 00000100:00100000:2.0:1789892576.615916:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892576.615922:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 24 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.615931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892576.615948:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970816 00000100:00100000:0.0:1789892576.615952:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970816 00010000:00010000:3.0:1789892576.615954:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892576.615963:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217458:x1876834915970176:12345-0@lo:104: Request processed in 93us (537us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892576.615966:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 25 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.615968:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970432 00000100:00100000:2.0:1789892576.615973:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970432 00000100:00100000:1.0:1789892576.615975:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915969920 00000100:00100000:3.0:1789892576.615979:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1789892576.615982:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915969920 00000100:00100000:0.0:1789892576.615991:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970304 00010000:00010000:2.0:1789892576.615995:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 27 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.615997:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970304 00010000:00010000:1.0:1789892576.616002:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 27 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.616005:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00010000:00010000:0.0:1789892576.616013:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 28 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.616022:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217458:x1876834915970560:12345-0@lo:104: 00000100:00100000:2.0:1789892576.616022:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915970944 00000100:00100000:2.0:1789892576.616027:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915970944 00010000:00010000:3.0:1789892576.616032:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616032:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00010000:00010000:2.0:1789892576.616041:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 29 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.616042:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1789892576.616047:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3620:x1876834915969792:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892576.616058:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3620:x1876834915970816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892576.616061:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892576.616068:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616069:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892576.616077:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00010000:00010000:0.0:1789892576.616078:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616082:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892576.616087:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.616092:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+29:3620:x1876834915970432:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892576.616093:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+4:217458:x1876834915970560:12345-0@lo:104: Request processed in 76us (555us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892576.616109:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892576.616112:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00010000:00010000:0.0:1789892576.616114:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616118:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.616126:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00010000:00010000:1.0:1789892576.616132:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800800/0x5c4f93dd00213a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a51 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616136:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801e00/0x5c4f93dd00213a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a19 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892576.616144:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069876c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217458:x1876834915970688:12345-0@lo:104: 00010000:00010000:2.0:1789892576.616144:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 29 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616153:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.616154:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892576.616162:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884ffea00/0x5c4f93dd00213a3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a35 expref: 28 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616170:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892576.616177:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892576.616190:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3620:x1876834915969792:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.616196:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1789892576.616222:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00010000:00010000:3.0:1789892576.616225:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892576.616230:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915970816:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.616235:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906883478e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3621:x1876834915969920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892576.616236:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3620:x1876834915970432:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892576.616237:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069876c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217458:x1876834915970688:12345-0@lo:104: Request processed in 95us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.616250:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00010000:00010000:1.0:1789892576.616252:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892576.616256:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1789892576.616257:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00010000:00010000:1.0:1789892576.616261:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 25 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.616271:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.616277:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1789892576.616285:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00010000:00010000:1.0:1789892576.616287:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fffa00/0x5c4f93dd00213a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a43 expref: 23 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.616292:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688f475c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:3622:x1876834915970304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616303:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789892576.616307:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688347a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915970944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892576.616307:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892576.616309:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892576.616310:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616319:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 22 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616322:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892576.616323:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878f000 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:3.0:1789892576.616330:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616331:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 22 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616335:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 22 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616341:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906883478e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3621:x1876834915969920:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (477us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892576.616348:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616359:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00010000:00010000:2.0:1789892576.616365:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 22 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892576.616367:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892576.616374:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892576.616381:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff000/0x5c4f93dd00213a2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a27 expref: 21 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616388:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837800/0x5c4f93dd00213a12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a0b expref: 21 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616393:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892576.616398:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915969920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616401:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616408:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892576.616409:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892576.616415:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789892576.616423:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616426:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915971072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892576.616433:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688f475c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3622:x1876834915970304:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892576.616445:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1789892576.616452:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688347a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915970944:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (520us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892576.616457:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878f000/0x5c4f93dd002139fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a04 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.616462:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1789892576.616465:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892576.616477:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892576.616482:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.616512:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971072 00000100:00100000:1.0:1789892576.616513:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915970944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616516:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688878e000 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:2.0:1789892576.616517:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971072 10000000:00010000:3.0:1789892576.616521:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616529:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892576.616537:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616538:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 18 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616544:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915970432:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789892576.616548:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892576.616559:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915970816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892576.616586:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00010000:00010000:3.0:1789892576.616593:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616593:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915969792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892576.616594:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970176:0@lo:104: 00000100:00100000:2.0:1789892576.616599:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915971072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616608:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892576.616612:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892576.616617:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789892576.616618:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 18 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616623:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616633:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688878e000/0x5c4f93dd002139ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002139f6 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616633:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 18 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616635:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915971200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892576.616636:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970560:0@lo:104: 00000100:00100000:0.0:1789892576.616653:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915970688:0@lo:104: 00010000:00010000:3.0:1789892576.616659:0:189427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892576.616660:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837600/0x5c4f93dd00213a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002139fd expref: 18 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616673:0:189427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616674:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892576.616677:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892576.616696:0:189427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837a00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:2.0:1789892576.616696:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1789892576.616700:0:189427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.616706:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971200 00010000:00010000:3.0:1789892576.616708:0:189427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.616711:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971200 10000000:00010000:3.0:1789892576.616718:0:189427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892576.616726:0:189427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892576.616736:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 18 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.616746:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:3621:x1876834915971072:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.616746:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915971072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616753:0:189427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616761:0:189427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892576.616763:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1789892576.616769:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1789892576.616779:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3620:x1876834915971200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616787:0:189427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616787:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892576.616792:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789892576.616794:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 17 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616805:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915971328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892576.616808:0:189427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906990837a00/0x5c4f93dd002139e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd002139e8 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892576.616813:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915970304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892576.616819:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 17 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892576.616833:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892576.616833:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd002139f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002139ef expref: 17 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.616835:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892576.616839:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892576.616842:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892576.616843:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892576.616855:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892576.616856:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892576.616866:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892576.616877:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971328 00000100:00100000:1.0:1789892576.616882:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971328 00000100:00100000:0.0:1789892576.616889:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688da6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:3620:x1876834915971200:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (218us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892576.616897:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 17 pid: 189432 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.616897:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1789892576.616918:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1789892576.616927:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3619:x1876834915971328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892576.616935:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892576.616940:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 16 pid: 189432 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.616944:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915971200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892576.616953:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 16 pid: 189432 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616964:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801200/0x5c4f93dd002139e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd002139e1 expref: 16 pid: 189432 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892576.616977:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892576.616981:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915968896:192.168.204.33@tcp:104: 00000100:00100000:2.0:1789892576.616998:0:217458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217458:1876834915969024:192.168.204.33@tcp:104: 00000100:00100000:0.0:1789892576.617022:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3619:x1876834915971328:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892576.617034:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892576.617034:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1789892576.617042:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915971328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892576.617061:0:192465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865856 00000100:00100000:0.0:1789892576.617065:0:192465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865856 00000100:00100000:3.0:1789892576.617079:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:0.0:1789892576.617083:0:192465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 10 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.617084:0:217458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.617102:0:189425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925865984 00000100:00100000:1.0:1789892576.617108:0:189425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925865984 00000100:00100000:0.0:1789892576.617121:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 590 00010000:00010000:1.0:1789892576.617124:0:189425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 11 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.617133:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925865856:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892576.617139:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892576.617144:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 11 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.617151:0:189425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 591 00010000:00010000:0.0:1789892576.617155:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 11 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.617163:0:189425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925865984:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892576.617168:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ae expref: 11 pid: 189434 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617172:0:189425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892576.617177:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892576.617179:0:189425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 10 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617189:0:189425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 10 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.617206:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae588d89-f458-4cef-8f6b-15cea35dd321+10:2399:x1876834925865856:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 75us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892576.617210:0:189425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6b5 expref: 10 pid: 189433 timeout: 3501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892576.617217:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 590 00010000:00010000:1.0:1789892576.617229:0:189425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617237:0:189425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617247:0:189425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617252:0:189425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617258:0:189425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617262:0:189425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617266:0:189425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906990837000 already unused, calling callback (ffffffffc0b48250) 00010000:00010000:1.0:1789892576.617269:0:189425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617273:0:189425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617285:0:189425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892576.617299:0:189425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892576.617312:0:217458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892576.617323:0:217458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892576.617324:0:189425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2400:x1876834925865984:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 166us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892576.617340:0:189425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 591 00010000:00010000:2.0:1789892576.617341:0:217458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837000/0x5c4f93dd00213a6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.058703:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892577.058737:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915971456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892577.058814:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.058873:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971456 00000100:00100000:0.0:1789892577.058883:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971456 00000100:00100000:0.0:1789892577.058953:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789892577.058965:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915971456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789892577.059012:0:189443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789892577.059070:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915971456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.059078:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789892577.059125:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915971456:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1789892577.250610:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892577.250617:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 190 10000000:01000000:1.0:1789892577.250621:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892577.250667:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.250677:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.250687:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892577.250708:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5519880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915971584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.250771:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.250808:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.250837:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971584 00000100:00100000:0.0:1789892577.250845:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971584 00000100:00100000:0.0:1789892577.250893:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:0.0:1789892577.250901:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915971584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892577.250913:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892577.250926:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a74 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.250947:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.250955:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 16 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.250962:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836e00, rc 0) 00000100:00100000:0.0:1789892577.251002:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915971584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.251008:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:1.0:1789892577.251051:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5519880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915971584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892577.251065:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.251073:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892577.251124:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5519880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915971712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.251162:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.251179:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.251204:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971712 00000100:00100000:0.0:1789892577.251208:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971712 00000100:00100000:0.0:1789892577.251230:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:0.0:1789892577.251235:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915971712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.251339:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915971712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.251345:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:1.0:1789892577.251367:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5519880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915971712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.251393:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5519880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915971840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.251430:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.251449:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.251465:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971840 00000100:00100000:0.0:1789892577.251469:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971840 00000100:00100000:0.0:1789892577.251523:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:0.0:1789892577.251532:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915971840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.251629:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915971840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.251634:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1789892577.251696:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5519880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915971840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.251998:0:217459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217459:1876834915971968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.252027:0:217459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.252049:0:217459:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.252084:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915971968 00000100:00100000:0.0:1789892577.252089:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915971968 00000100:00100000:0.0:1789892577.252115:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:0.0:1789892577.252120:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217459:x1876834915971968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.252201:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217459:x1876834915971968:12345-0@lo:502:llog_process_th.0 Request processed in 80us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.252208:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:1.0:1789892577.252228:0:217459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217459:1876834915971968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.252264:0:217459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217459:1876834915972096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.252290:0:217459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.252304:0:217459:0:(client.c:2702:ptlrpc_set_wait()) set ffff906884725240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.252326:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972096 00000100:00100000:0.0:1789892577.252330:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972096 00000100:00100000:0.0:1789892577.252353:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1789892577.252361:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217459:x1876834915972096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.252438:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217459:x1876834915972096:12345-0@lo:502:llog_process_th.0 Request processed in 76us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.252447:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:1.0:1789892577.252458:0:217459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217459:1876834915972096:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892577.252486:0:217459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:2.0:1789892577.252613:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1789892577.252647:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892577.252655:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.252666:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.252675:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892577.252677:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 41 10000000:01000000:2.0:1789892577.252680:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892577.252698:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.252707:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.252717:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.252732:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.252764:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.252794:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.252805:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972224 00000100:00100000:0.0:1789892577.252810:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972224 00000100:00100000:0.0:1789892577.252837:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:0.0:1789892577.252841:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915972224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892577.252846:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892577.252855:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a82 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.252868:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 17 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.252876:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 17 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.252881:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837200, rc 0) 00000100:00100000:0.0:1789892577.252907:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915972224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.252911:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1789892577.252950:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.252964:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.252973:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.253039:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.253068:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.253087:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.253105:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972352 00000100:00100000:0.0:1789892577.253109:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972352 00000100:00100000:0.0:1789892577.253129:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:0.0:1789892577.253134:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915972352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.253191:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915972352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.253196:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:2.0:1789892577.253239:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.253268:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.253307:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.253327:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.253345:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972480 00000100:00100000:0.0:1789892577.253349:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972480 00000100:00100000:0.0:1789892577.253369:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1789892577.253373:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915972480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.253428:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915972480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.253437:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1789892577.253470:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892577.254115:0:217460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 41 00000020:01000000:2.0:1789892577.254178:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 41-40 (rc=0) 10000000:01000000:2.0:1789892577.254197:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892577.254204:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.254214:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.254222:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892577.254224:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 190 10000000:01000000:2.0:1789892577.254227:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892577.254244:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.254252:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.254262:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.254283:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.254311:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.254339:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.254343:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972608 00000100:00100000:0.0:1789892577.254347:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972608 00000100:00100000:0.0:1789892577.254370:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:0.0:1789892577.254375:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915972608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892577.254381:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892577.254388:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a90 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.254400:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.254406:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 18 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.254411:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837a00, rc 0) 00000100:00100000:0.0:1789892577.254436:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915972608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.254440:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:2.0:1789892577.254477:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.254512:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.254523:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.254583:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.254611:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.254635:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972736 00000100:00100000:0.0:1789892577.254639:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972736 00000100:00100000:2.0:1789892577.254640:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.254665:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1789892577.254671:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915972736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.254723:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915972736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.254730:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:2.0:1789892577.254753:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.254780:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.254816:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.254835:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.254836:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972864 00000100:00100000:0.0:1789892577.254841:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972864 00000100:00100000:0.0:1789892577.254861:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1789892577.254866:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915972864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.254916:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915972864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.254922:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1789892577.254945:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915972864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.255123:0:217461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217461:1876834915972992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.255151:0:217461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.255166:0:217461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069af42eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.255182:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915972992 00000100:00100000:1.0:1789892577.255187:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915972992 00000100:00100000:1.0:1789892577.255215:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1789892577.255220:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217461:x1876834915972992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.255295:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217461:x1876834915972992:12345-0@lo:502:llog_process_th.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.255302:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:0.0:1789892577.255315:0:217461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217461:1876834915972992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.255346:0:217461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217461:1876834915973120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.255372:0:217461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.255387:0:217461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069af42eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.255401:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973120 00000100:00100000:1.0:1789892577.255405:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973120 00000100:00100000:1.0:1789892577.255438:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1789892577.255446:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217461:x1876834915973120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.255528:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217461:x1876834915973120:12345-0@lo:502:llog_process_th.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.255535:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:0.0:1789892577.255542:0:217461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217461:1876834915973120:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892577.255575:0:217461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:2.0:1789892577.255638:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1789892577.255659:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892577.255665:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.255674:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.255688:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892577.255690:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 44 10000000:01000000:2.0:1789892577.255693:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892577.255708:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.255717:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.255726:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.255740:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.255768:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.255798:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.255799:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973248 00000100:00100000:1.0:1789892577.255805:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973248 00000100:00100000:1.0:1789892577.255828:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:1.0:1789892577.255834:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915973248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892577.255840:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892577.255847:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213a9e expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.255860:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 19 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.255866:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 19 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.255871:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801400, rc 0) 00000100:00100000:1.0:1789892577.255896:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915973248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.255900:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1789892577.255936:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.255948:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.255957:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.255994:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.256022:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.256039:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.256052:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973376 00000100:00100000:1.0:1789892577.256056:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973376 00000100:00100000:1.0:1789892577.256078:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:1.0:1789892577.256082:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915973376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.256141:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915973376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.256152:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1789892577.256161:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.256189:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.256234:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.256248:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.256264:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973504 00000100:00100000:1.0:1789892577.256268:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973504 00000100:00100000:1.0:1789892577.256289:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:1.0:1789892577.256293:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915973504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.256349:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915973504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.256355:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1789892577.256371:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892577.256974:0:217462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 44 00000020:01000000:2.0:1789892577.257034:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 44-43 (rc=0) 10000000:01000000:2.0:1789892577.257054:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892577.257060:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.257068:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.257077:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892577.257079:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 190 10000000:01000000:2.0:1789892577.257082:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892577.257097:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.257104:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.257112:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.257125:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.257152:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.257174:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973632 00000100:00100000:1.0:1789892577.257178:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973632 00000100:00100000:2.0:1789892577.257183:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.257206:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1789892577.257212:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915973632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892577.257218:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892577.257224:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213aac expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.257235:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.257241:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 20 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.257246:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801c00, rc 0) 00000100:00100000:1.0:1789892577.257271:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915973632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.257277:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1789892577.257306:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.257327:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.257335:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.257370:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.257397:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.257417:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.257417:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973760 00000100:00100000:1.0:1789892577.257424:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973760 00000100:00100000:1.0:1789892577.257453:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1789892577.257462:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915973760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.257571:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915973760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.257579:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:2.0:1789892577.257606:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.257631:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.257669:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.257690:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915973888 00000100:00100000:1.0:1789892577.257695:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915973888 00000100:00100000:2.0:1789892577.257698:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.257722:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1789892577.257727:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915973888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.257780:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915973888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.257786:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1789892577.257808:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915973888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.257979:0:217463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217463:1876834915974016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.258007:0:217463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.258022:0:217463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069bfddf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.258074:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974016 00000100:00100000:0.0:1789892577.258080:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974016 00000100:00100000:0.0:1789892577.258106:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:0.0:1789892577.258113:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217463:x1876834915974016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.258184:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217463:x1876834915974016:12345-0@lo:502:llog_process_th.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.258191:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1789892577.258199:0:217463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217463:1876834915974016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.258232:0:217463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217463:1876834915974144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.258257:0:217463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.258271:0:217463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069bfddf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.258286:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974144 00000100:00100000:0.0:1789892577.258290:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974144 00000100:00100000:0.0:1789892577.258317:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:0.0:1789892577.258323:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217463:x1876834915974144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.258376:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217463:x1876834915974144:12345-0@lo:502:llog_process_th.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.258382:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1789892577.258392:0:217463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217463:1876834915974144:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892577.258412:0:217463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:2.0:1789892577.258479:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1789892577.258535:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892577.258542:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.258552:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.258577:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892577.258579:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 218 10000000:01000000:2.0:1789892577.258587:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892577.258603:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.258622:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.258631:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.258645:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.258673:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.258705:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974272 00000100:00100000:2.0:1789892577.258707:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.258710:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974272 00000100:00100000:0.0:1789892577.258734:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:0.0:1789892577.258739:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915974272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892577.258745:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892577.258753:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213aba expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.258765:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 21 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.258772:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 21 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.258776:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837c00, rc 0) 00000100:00100000:0.0:1789892577.258800:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915974272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.258806:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:2.0:1789892577.258830:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.258842:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.258850:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.258885:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.258912:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.258930:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.258930:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974400 00000100:00100000:0.0:1789892577.258935:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974400 00000100:00100000:0.0:1789892577.258956:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1789892577.258961:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915974400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.259012:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915974400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.259023:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:2.0:1789892577.259040:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.259065:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.259099:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.259115:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.259116:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974528 00000100:00100000:0.0:1789892577.259121:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974528 00000100:00100000:0.0:1789892577.259142:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1789892577.259147:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915974528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.259199:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915974528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.259204:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:2.0:1789892577.259230:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.259395:0:217464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217464:1876834915974656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.259423:0:217464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.259437:0:217464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069a02236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.259458:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974656 00000100:00100000:1.0:1789892577.259463:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974656 00000100:00100000:1.0:1789892577.259515:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:1.0:1789892577.259521:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217464:x1876834915974656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.259607:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217464:x1876834915974656:12345-0@lo:502:llog_process_th.0 Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.259613:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:0.0:1789892577.259622:0:217464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217464:1876834915974656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892577.259644:0:217464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892577.259652:0:217464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892577.259654:0:217464:0:(obd_config.c:1561:class_process_config()) marker 209 (0x1) lustre-MDT0001-m new lustre.qpool1 00000020:00000080:0.0:1789892577.259658:0:217464:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1789892577.259704:0:217464:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00000100:00100000:0.0:1789892577.259719:0:217464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217464:1876834915974784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.259744:0:217464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.259765:0:217464:0:(client.c:2702:ptlrpc_set_wait()) set ffff906982aaa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.259774:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974784 00000100:00100000:1.0:1789892577.259778:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974784 00000100:00100000:1.0:1789892577.259800:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:1.0:1789892577.259804:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217464:x1876834915974784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.259857:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217464:x1876834915974784:12345-0@lo:502:llog_process_th.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.259863:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:0.0:1789892577.259874:0:217464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217464:1876834915974784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892577.259894:0:217464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892577.259897:0:217464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892577.259899:0:217464:0:(obd_config.c:1561:class_process_config()) marker 209 (0x2) lustre-MDT0001-m new lustre.qpool1 00000040:00080000:0.0:1789892577.259901:0:217464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 221 count 217 00000020:01000000:2.0:1789892577.259965:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 218-220 (rc=0) 10000000:01000000:2.0:1789892577.259990:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892577.259997:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.260005:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.260014:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892577.260016:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 190 10000000:01000000:2.0:1789892577.260018:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892577.260033:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.260041:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.260049:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.260062:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.260091:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.260111:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.260122:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915974912 00000100:00100000:1.0:1789892577.260126:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915974912 00000100:00100000:1.0:1789892577.260147:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1789892577.260151:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915974912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892577.260156:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892577.260162:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213ac8 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.260173:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.260179:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 22 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.260184:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801a00, rc 0) 00000100:00100000:1.0:1789892577.260210:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915974912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.260221:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:2.0:1789892577.260253:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915974912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.260265:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.260274:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.260312:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.260348:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.260368:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.260378:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975040 00000100:00100000:1.0:1789892577.260382:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975040 00000100:00100000:1.0:1789892577.260403:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1789892577.260407:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915975040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.260475:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915975040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.260484:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:2.0:1789892577.260518:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.260545:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.260596:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.260619:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975168 00000100:00100000:1.0:1789892577.260623:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975168 00000100:00100000:2.0:1789892577.260625:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.260650:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1789892577.260656:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915975168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.260707:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915975168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.260713:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:2.0:1789892577.260738:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.260916:0:217465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217465:1876834915975296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.260944:0:217465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.260958:0:217465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069bfddf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.261007:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975296 00000100:00100000:0.0:1789892577.261018:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975296 00000100:00100000:0.0:1789892577.261045:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:0.0:1789892577.261051:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217465:x1876834915975296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.261118:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217465:x1876834915975296:12345-0@lo:502:llog_process_th.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.261124:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1789892577.261131:0:217465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217465:1876834915975296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.261163:0:217465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217465:1876834915975424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.261188:0:217465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.261201:0:217465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069bfddf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.261210:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975424 00000100:00100000:0.0:1789892577.261214:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975424 00000100:00100000:0.0:1789892577.261234:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:0.0:1789892577.261240:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217465:x1876834915975424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.261293:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217465:x1876834915975424:12345-0@lo:502:llog_process_th.0 Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.261299:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:1.0:1789892577.261310:0:217465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217465:1876834915975424:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892577.261329:0:217465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:2.0:1789892577.261386:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1789892577.261400:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892577.261405:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.261411:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.261416:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892577.261417:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 218 10000000:01000000:2.0:1789892577.261419:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892577.261430:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.261435:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.261440:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.261448:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.261473:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.261487:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.261531:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975552 00000100:00100000:0.0:1789892577.261535:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975552 00000100:00100000:0.0:1789892577.261572:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1789892577.261578:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915975552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892577.261583:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892577.261590:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213ad6 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.261602:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.261608:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892577.261613:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836000, rc 0) 00000100:00100000:0.0:1789892577.261643:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915975552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.261648:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:2.0:1789892577.261678:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.261687:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.261693:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.261719:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.261737:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.261757:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.261761:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975680 00000100:00100000:0.0:1789892577.261767:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975680 00000100:00100000:0.0:1789892577.261797:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:0.0:1789892577.261804:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915975680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.261876:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915975680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.261883:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:2.0:1789892577.261898:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.261917:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.261943:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.261955:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892577.261965:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975808 00000100:00100000:0.0:1789892577.261971:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975808 00000100:00100000:0.0:1789892577.261999:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:0.0:1789892577.262006:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915975808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.262082:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915975808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892577.262088:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1789892577.262096:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915975808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892577.262346:0:217466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217466:1876834915975936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.262380:0:217466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.262399:0:217466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9069af60a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.262415:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915975936 00000100:00100000:1.0:1789892577.262422:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915975936 00000100:00100000:1.0:1789892577.262455:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:1.0:1789892577.262464:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217466:x1876834915975936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.262610:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217466:x1876834915975936:12345-0@lo:502:llog_process_th.0 Request processed in 148us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.262616:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1789892577.262633:0:217466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217466:1876834915975936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892577.262658:0:217466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892577.262665:0:217466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892577.262667:0:217466:0:(obd_config.c:1561:class_process_config()) marker 208 (0x1) lustre-MDT0000-m new lustre.qpool1 00000020:00000080:0.0:1789892577.262671:0:217466:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1789892577.262706:0:217466:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00080000:10000000:0.0:1789892577.263170:0:217466:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5c:0x0] (8/32) registered 00080000:10000000:0.0:1789892577.264472:0:217466:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5d:0x0] (8/32) registered 00080000:10000000:0.0:1789892577.265446:0:217466:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5e:0x0] (8/32) registered 00000100:00100000:0.0:1789892577.266237:0:217466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217466:1876834915976064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892577.266276:0:217466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892577.266302:0:217466:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688a61e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.266345:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976064 00000100:00100000:1.0:1789892577.266350:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976064 00000100:00100000:1.0:1789892577.266377:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:1.0:1789892577.266382:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217466:x1876834915976064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892577.266458:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217466:x1876834915976064:12345-0@lo:502:llog_process_th.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.266467:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:0.0:1789892577.266481:0:217466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217466:1876834915976064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892577.266519:0:217466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892577.266525:0:217466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892577.266528:0:217466:0:(obd_config.c:1561:class_process_config()) marker 208 (0x2) lustre-MDT0000-m new lustre.qpool1 00000040:00080000:0.0:1789892577.266533:0:217466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 221 count 217 00000020:01000000:2.0:1789892577.266599:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 218-220 (rc=0) 10000000:01000000:2.0:1789892577.266626:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892577.266632:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.266643:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892577.266652:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892577.266661:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:2.0:1789892577.266664:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892577.266681:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.266689:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.266698:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.266712:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915976192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.266745:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.266775:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.266785:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976192 00000100:00100000:1.0:1789892577.266789:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976192 00000100:00100000:1.0:1789892577.266812:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1789892577.266816:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915976192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892577.266822:0:189433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892577.266829:0:189433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213ae4 expref: -99 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.266843:0:189433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.266850:0:189433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892577.266864:0:189433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800a00, rc 0) 00000100:00100000:1.0:1789892577.266892:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915976192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.266897:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:2.0:1789892577.266934:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915976192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892577.266947:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.266956:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.266997:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915976320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892577.267026:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892577.267047:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892577.267058:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976320 00000100:00100000:1.0:1789892577.267062:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976320 00000100:00100000:1.0:1789892577.267083:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1789892577.267087:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915976320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892577.267130:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915976320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 42us (104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892577.267136:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:2.0:1789892577.267152:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915976320:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892577.267172:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892577.267175:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892577.267189:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892577.570660:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915976448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892577.570728:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892577.570770:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976448 00000100:00100000:1.0:1789892577.570778:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976448 00000100:00100000:1.0:1789892577.570834:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789892577.570844:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915976448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789892577.570875:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:1.0:1789892577.570928:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915976448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892577.570935:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789892577.570975:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915976448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892578.082736:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915976576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892578.082755:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915976960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892578.082800:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915976704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892578.082802:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915976832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892578.082831:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892578.082832:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892578.082870:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.082891:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976576 00000100:00100000:1.0:1789892578.082893:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915977088:0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.082899:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976576 00000100:00100000:0.0:1789892578.082911:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915977216:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.082949:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.082954:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976704 00000100:00100000:0.0:1789892578.082966:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.082970:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976704 00000100:00080000:2.0:1789892578.082982:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789892578.082988:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892578.082996:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789892578.083006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.083010:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915976576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892578.083014:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915977728:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.083017:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915977600:0@lo:400:kworker.0 00000100:00100000:2.0:1789892578.083058:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915977344:0@lo:400:kworker.0 00002000:00000024:3.0:1789892578.083060:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892578.083077:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892578.083120:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915978240:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.083137:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892578.083138:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.083147:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915976576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892578.083157:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789892578.083181:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915978112:0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.083183:0:190947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976832 00000100:00100000:0.0:1789892578.083188:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.083190:0:190947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976832 00000100:00100000:2.0:1789892578.083195:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915977856:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.083246:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.083256:0:190947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789892578.083266:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789892578.083273:0:190947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915976704:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892578.083280:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977216 00000100:00100000:2.0:1789892578.083282:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915976832:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892578.083291:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977216 00002000:00000024:3.0:1789892578.083294:0:190947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789892578.083300:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892578.083308:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915976576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892578.083369:0:189443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977600 00000100:00100000:0.0:1789892578.083377:0:189443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977600 00000100:00100000:2.0:1789892578.083383:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915976832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.083385:0:189433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977088 00000100:00100000:3.0:1789892578.083391:0:190947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915976704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.083395:0:189433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977088 00000100:00100000:2.0:1789892578.083401:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789892578.083417:0:190947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789892578.083419:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789892578.083440:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915977216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892578.083445:0:190944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977728 00000100:00100000:2.0:1789892578.083452:0:190944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977728 00000100:00100000:1.0:1789892578.083456:0:189433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:3.0:1789892578.083471:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977344 00000100:00100000:1.0:1789892578.083472:0:189433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915977088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.083477:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977344 00000100:00100000:2.0:1789892578.083564:0:190944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789892578.083576:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915977216:12345-0@lo:400:kworker.0 Request processed in 136us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892578.083580:0:190944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915977728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.083586:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789892578.083615:0:189433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915977088:12345-0@lo:400:kworker.0 Request processed in 129us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892578.083625:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915977344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892578.083626:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789892578.083630:0:189433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:2.0:1789892578.083651:0:190944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915977728:12345-0@lo:400:kworker.0 Request processed in 70us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892578.083670:0:190944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789892578.083678:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789892578.083699:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915977600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.083701:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915977344:12345-0@lo:400:kworker.0 Request processed in 85us (582us total) trans 0 rc 0/0 00000100:00080000:2.0:1789892578.083711:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892578.083712:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915978240 00000100:00080000:2.0:1789892578.083721:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789892578.083721:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915978240 00000100:00100000:3.0:1789892578.083722:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:3.0:1789892578.083769:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892578.083791:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915977728:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.083797:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915978112 00000100:00100000:1.0:1789892578.083802:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915978112 00000100:00100000:0.0:1789892578.083803:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876834915977600:12345-0@lo:400:kworker.0 Request processed in 110us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892578.083811:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915977216:0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.083827:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1789892578.083827:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789892578.083843:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915976704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892578.083845:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915978240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.083856:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1789892578.083867:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915978112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892578.083899:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.083901:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876834915978240:12345-0@lo:400:kworker.0 Request processed in 58us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892578.083907:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1876834915978240:0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.083912:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1789892578.083917:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876834915978112:12345-0@lo:400:kworker.0 Request processed in 50us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.083925:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00080000:2.0:1789892578.083944:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892578.083947:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915977472:0@lo:400:kworker.0 00000100:00100000:2.0:1789892578.083974:0:190946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915976960 00000100:00100000:2.0:1789892578.083978:0:190946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915976960 00000100:00100000:1.0:1789892578.083996:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.083999:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1876834915977600:0@lo:400:kworker.0 00000100:00100000:2.0:1789892578.084011:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00010000:00080000:3.0:1789892578.084020:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9069bcc91880 x1876834915978112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892578.084022:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915976960:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892578.084030:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915978368:0@lo:400:kworker.0 00002000:00000024:2.0:1789892578.084049:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892578.084054:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1876834915978112:0@lo:400:kworker.0 00000100:00100000:0.0:1789892578.084055:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.084079:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915977088:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.084083:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977856 00000100:00100000:1.0:1789892578.084090:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977856 00000100:00100000:2.0:1789892578.084098:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915976960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892578.084105:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789892578.084110:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915977984:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.084132:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977472 00000100:00100000:1.0:1789892578.084138:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977472 00000100:00100000:2.0:1789892578.084143:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1789892578.084152:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892578.084156:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915977856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.084172:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915977984 00000100:00100000:1.0:1789892578.084186:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915977984 00000100:00100000:3.0:1789892578.084187:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789892578.084204:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876834915977856:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892578.084211:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3622:x1876834915977472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892578.084215:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1789892578.084220:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915976960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892578.084240:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789892578.084251:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915977984:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789892578.084258:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892578.084279:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3622:x1876834915977472:12345-0@lo:400:kworker.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.084287:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892578.084294:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789892578.084294:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3622:x1876834915977984:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892578.084296:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1876834915977472:0@lo:400:kworker.0 00000100:00100000:2.0:1789892578.084311:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1789892578.084313:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915978368 00000100:00100000:3.0:1789892578.084317:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915978368 00000100:00100000:0.0:1789892578.084336:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1876834915977984:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.084357:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915976832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892578.084372:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1789892578.084381:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915978368:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789892578.084386:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892578.084396:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915977344:0@lo:400:kworker.0 00000100:00100000:1.0:1789892578.084415:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876834915977856:0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.084444:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876834915978368:12345-0@lo:400:kworker.0 Request processed in 62us (160us total) trans 0 rc 0/0 00010000:00080000:1.0:1789892578.084453:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90689d2e8700 x1876834915978368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892578.084459:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1789892578.084488:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1876834915978368:0@lo:400:kworker.0 00000100:00100000:3.0:1789892578.383874:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892578.383977:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866112 00000100:00100000:1.0:1789892578.383988:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866112 00000100:00100000:1.0:1789892578.384061:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2511 00000100:00100000:1.0:1789892578.384092:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925866112:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892578.384110:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892578.384131:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6bc expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892578.384170:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892578.384181:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892578.384189:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f800600, rc 0) 00000100:00100000:1.0:1789892578.384239:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925866112:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 169us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.384275:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2511 00000100:00100000:1.0:1789892578.385594:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892578.385665:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866240 00000100:00100000:3.0:1789892578.385672:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866240 00000100:00100000:3.0:1789892578.385715:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2512 00000100:00100000:3.0:1789892578.385737:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925866240:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892578.385924:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925866240:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 188us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892578.385938:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2512 00000100:00100000:3.0:1789892578.387061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892578.387109:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866368 00000100:00100000:1.0:1789892578.387115:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866368 00000100:00100000:1.0:1789892578.387147:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2513 00000100:00100000:1.0:1789892578.387156:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925866368:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892578.387249:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925866368:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.387262:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2513 00000100:00100000:1.0:1789892578.388731:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892578.388818:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866496 00000100:00100000:3.0:1789892578.388824:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866496 00000100:00100000:3.0:1789892578.388852:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2514 00000100:00100000:3.0:1789892578.388859:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215749:x1876834925866496:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892578.388963:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215749:x1876834925866496:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892578.388972:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2514 00000100:00100000:3.0:1789892578.389980:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892578.390038:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866624 00000100:00100000:1.0:1789892578.390045:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866624 00000100:00100000:1.0:1789892578.390080:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2515 00000100:00100000:1.0:1789892578.390118:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215749:x1876834925866624:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892578.390212:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215749:x1876834925866624:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892578.390222:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2515 00000100:00100000:0.0:1789892578.391384:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892578.391615:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866752 00000100:00100000:3.0:1789892578.391621:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866752 00000100:00100000:3.0:1789892578.391668:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2516 00000100:00100000:3.0:1789892578.391678:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925866752:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892578.391690:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892578.391705:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6c3 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892578.391729:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892578.391742:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892578.391763:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f000, rc 0) 00000100:00100000:3.0:1789892578.391795:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925866752:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 119us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892578.391801:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2516 00000100:00100000:3.0:1789892578.392527:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892578.392581:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925866880 00000100:00100000:1.0:1789892578.392587:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925866880 00000100:00100000:1.0:1789892578.392619:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2517 00000100:00100000:1.0:1789892578.392626:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925866880:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892578.392676:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925866880:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 51us (148us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892578.392681:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2517 00010000:00010000:3.0:1789892579.106733:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789892579.419299:0:217564:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe39c90930 20000000:00000080:2.0:1789892579.419315:0:217564:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9068835acc00 uarg=0000000000000000 00000040:00100000:2.0:1789892579.420025:0:217564:0:(llog.c:1072:llog_reverse_process()) index 192 : idx 181 20000000:01000000:2.0:1789892579.420030:0:217564:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 191 cmd:0xce020 lustre.qpool1 00000040:00080000:2.0:1789892579.420098:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].193, 224 off43416 20000000:01000000:2.0:1789892579.420112:0:217564:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892579.420123:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].194, 128 off43544 00000040:00080000:2.0:1789892579.420134:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].195, 224 off43768 00000040:00080000:2.0:1789892579.420171:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].221, 224 off48784 20000000:01000000:2.0:1789892579.420177:0:217564:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892579.420187:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].222, 136 off48920 00000040:00080000:2.0:1789892579.420214:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].224, 224 off49376 00000040:00080000:2.0:1789892579.420250:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].221, 224 off48784 20000000:01000000:2.0:1789892579.420255:0:217564:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892579.420263:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].222, 136 off48920 00000040:00080000:2.0:1789892579.420287:0:217564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].224, 224 off49376 10000000:01000000:2.0:1789892579.420294:0:217564:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892579.420310:0:217564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420325:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420331:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420336:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420348:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420353:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420358:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420362:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420367:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420371:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420378:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420383:0:217564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420388:0:217564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420419:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 9 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420436:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 9 pid: 189432 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.420447:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978496:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892579.420613:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420634:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 9 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.420651:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978624:192.168.204.33@tcp:104: 00010000:00010000:2.0:1789892579.420704:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420716:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 23 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.420729:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978752:0@lo:104: 00000100:00100000:2.0:1789892579.420789:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892579.420850:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420884:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 23 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.420893:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978880:0@lo:104: 00000100:00100000:2.0:1789892579.420916:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892579.420945:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915978752 00000100:00100000:3.0:1789892579.420952:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915978752 00010000:00010000:2.0:1789892579.420956:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.420966:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 23 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.420970:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915978880 00000100:00100000:2.0:1789892579.420977:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979008:0@lo:104: 00000100:00100000:0.0:1789892579.420979:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915978880 00000100:00100000:2.0:1789892579.421013:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892579.421040:0:189423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979008 00000100:00100000:0.0:1789892579.421045:0:189423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979008 00000100:00100000:3.0:1789892579.421049:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789892579.421056:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1789892579.421064:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217564:x1876834915978752:12345-0@lo:104: 00000100:00100000:0.0:1789892579.421071:0:189423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00010000:00010000:2.0:1789892579.421077:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.421083:0:189423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217564:x1876834915979008:12345-0@lo:104: 00010000:00010000:0.0:1789892579.421097:0:189423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421128:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217564:x1876834915978880:12345-0@lo:104: 00010000:00010000:3.0:1789892579.421139:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.421143:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892579.421151:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217564:x1876834915978752:12345-0@lo:104: Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892579.421170:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00010000:00010000:0.0:1789892579.421172:0:189423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892579.421176:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789892579.421181:0:189423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:784a6601-8373-4a3c-bbd0-38e03e19eb16+5:217564:x1876834915979008:12345-0@lo:104: Request processed in 100us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892579.421185:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.421192:0:189423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00010000:00010000:1.0:1789892579.421200:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe200 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892579.421204:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421214:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.421215:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421216:0:200528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892579.421233:0:200528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.421248:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421253:0:200528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffc00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:2.0:1789892579.421254:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 23 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892579.421259:0:200528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892579.421263:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892579.421280:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789892579.421282:0:200528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421286:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979136:0@lo:104: 00000100:00100000:3.0:1789892579.421299:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90689d2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915978880:12345-0@lo:104: Request processed in 229us (371us total) trans 0 rc 0/0 10000000:00010000:0.0:1789892579.421300:0:200528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892579.421308:0:200528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892579.421311:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421317:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892579.421327:0:200528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421332:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892579.421335:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421339:0:200528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892579.421347:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe200/0x5c4f93dd00213ae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213aeb expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421359:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892579.421364:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421367:0:200528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.421371:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 23 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421372:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00010000:00010000:1.0:1789892579.421377:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffec00 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892579.421384:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421388:0:200528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffc00/0x5c4f93dd00213ac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213acf expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421391:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979136 00010000:00010000:2.0:1789892579.421394:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 23 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421398:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979136 00010000:00010000:1.0:1789892579.421413:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421427:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1789892579.421427:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979520:0@lo:104: 10000000:00010000:1.0:1789892579.421437:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421442:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892579.421443:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915979136:12345-0@lo:104: 00010000:00010000:0.0:1789892579.421447:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892579.421448:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892579.421450:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892579.421459:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421463:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892579.421467:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b551b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915979264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892579.421475:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421483:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892579.421565:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421573:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffec00/0x5c4f93dd00213ad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213add expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.421583:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892579.421585:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892579.421590:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892579.421591:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421597:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915979136:12345-0@lo:104: Request processed in 157us (267us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892579.421600:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffe800 already unused, calling callback (ffffffffc112ec20) 10000000:00010000:1.0:1789892579.421605:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421613:0:193632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979520 00000100:00100000:3.0:1789892579.421617:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1789892579.421620:0:193632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979520 00010000:00010000:1.0:1789892579.421622:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.421632:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.421645:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915979392:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789892579.421647:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892579.421648:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892579.421654:0:193632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00010000:00010000:3.0:1789892579.421659:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892579.421665:0:193632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915979520:12345-0@lo:104: 00000100:00100000:0.0:1789892579.421674:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892579.421676:0:193632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421677:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.421694:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789892579.421695:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421699:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892579.421704:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b551aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915979648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.421719:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 23 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421720:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.421742:0:193632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892579.421742:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892579.421748:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979904:0@lo:104: 00010000:00010000:1.0:1789892579.421748:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffe800/0x5c4f93dd00213aba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213ac1 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421752:0:193632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915979520:12345-0@lo:104: Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892579.421769:0:193632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00010000:00010000:1.0:1789892579.421776:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892579.421777:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979264 00000100:00100000:0.0:1789892579.421781:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979264 00010000:00010000:1.0:1789892579.421784:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.421788:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892579.421792:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892579.421799:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff200 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892579.421804:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 24 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.421806:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421811:0:189472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979904 00000100:00100000:2.0:1789892579.421819:0:189472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979904 00010000:00010000:1.0:1789892579.421824:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.421834:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892579.421841:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892579.421852:0:189472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00010000:00010000:1.0:1789892579.421858:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421863:0:189472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915979904:12345-0@lo:104: 00010000:00010000:1.0:1789892579.421875:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892579.421878:0:189472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421895:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.421895:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979392 00000100:00100000:0.0:1789892579.421900:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979392 00010000:00010000:1.0:1789892579.421908:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff200/0x5c4f93dd00213aac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213ab3 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.421916:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 25 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421924:0:190190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892579.421925:0:189472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1789892579.421932:0:190190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421934:0:189472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688ebb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915979904:12345-0@lo:104: Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892579.421935:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979648 00000100:00100000:0.0:1789892579.421940:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979648 00010000:00010000:3.0:1789892579.421951:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 26 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421953:0:190190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff000 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892579.421954:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 26 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.421955:0:189472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 10000000:00010000:1.0:1789892579.421962:0:190190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.421979:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 26 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.421980:0:190190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.421995:0:190190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422001:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 10000000:01000000:1.0:1789892579.422009:0:190190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892579.422011:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915980160:0@lo:104: 00000100:00100000:2.0:1789892579.422013:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1789892579.422019:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688f477c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915979264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892579.422029:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915979392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892579.422031:0:190190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.422044:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892579.422045:0:190190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892579.422054:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 26 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422057:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892579.422060:0:190190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.422065:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 26 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422067:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 26 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.422079:0:190190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fff000/0x5c4f93dd00213a9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213aa5 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.422094:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892579.422099:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 26 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.422108:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892579.422112:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892579.422116:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892579.422118:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892579.422135:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688f477c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3622:x1876834915979264:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892579.422138:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915979776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892579.422151:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+26:3619:x1876834915979392:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892579.422151:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1789892579.422163:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1789892579.422177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892579.422188:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892579.422190:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915979776 00000100:00100000:2.0:1789892579.422194:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915979776 00000100:00100000:1.0:1789892579.422200:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789892579.422209:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915980032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892579.422213:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 25 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422216:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00010000:00010000:3.0:1789892579.422229:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 25 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422230:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3619:x1876834915979648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892579.422252:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892579.422253:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1789892579.422253:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892579.422262:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 25 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.422262:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 25 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422270:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3621:x1876834915979776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892579.422285:0:189422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789892579.422288:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 25 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.422289:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915980416:0@lo:104: 00010000:00010000:2.0:1789892579.422289:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892579.422295:0:189422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980160 00010000:00010000:2.0:1789892579.422299:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 25 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.422301:0:189422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980160 00010000:00010000:0.0:1789892579.422307:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892579.422316:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 25 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422332:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892579.422337:0:189422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1789892579.422338:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892579.422344:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+25:3619:x1876834915979648:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892579.422350:0:189422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688274bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915980160:12345-0@lo:104: 00000100:00100000:0.0:1789892579.422355:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00010000:00010000:1.0:1789892579.422358:0:189422:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422372:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980032 00000100:00100000:0.0:1789892579.422378:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980032 00010000:00010000:3.0:1789892579.422380:0:217564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 24 pid: 189433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422380:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915979776:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892579.422390:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00010000:00010000:0.0:1789892579.422394:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 25 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.422403:0:189422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892579.422410:0:217564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 24 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.422414:0:189422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688274bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915980160:12345-0@lo:104: Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892579.422422:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980416 00000100:00100000:2.0:1789892579.422428:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980416 00000100:00100000:1.0:1789892579.422433:0:189422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1789892579.422441:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915980544:0@lo:104: 00000100:00100000:0.0:1789892579.422459:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789892579.422464:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1789892579.422471:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915980032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892579.422474:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789892579.422478:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915980416:12345-0@lo:104: 00000100:00100000:3.0:1789892579.422480:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892579.422482:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.422483:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892579.422525:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.422529:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fffa00 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:0.0:1789892579.422535:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 24 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.422536:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.422547:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 24 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.422551:0:217564:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789892579.422551:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.422558:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892579.422561:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892579.422568:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892579.422587:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978496:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892579.422591:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422592:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892579.422603:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915980416:12345-0@lo:104: Request processed in 130us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892579.422604:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978624:192.168.204.33@tcp:104: 00010000:00010000:1.0:1789892579.422607:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892579.422610:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3621:x1876834915980032:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892579.422622:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00010000:00010000:1.0:1789892579.422623:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422624:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00010000:00010000:3.0:1789892579.422626:0:217564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800a00/0x5c4f93dd00213aeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213ae4 expref: 24 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422639:0:193633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980544 00000100:00100000:2.0:1789892579.422645:0:193633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980544 00010000:00010000:1.0:1789892579.422649:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a97 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.422655:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978752:0@lo:104: 00010000:00010000:1.0:1789892579.422664:0:189428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892579.422668:0:189428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422671:0:193633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00010000:00010000:3.0:1789892579.422674:0:217564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836000/0x5c4f93dd00213add lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213ad6 expref: 22 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422684:0:193633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915980544:12345-0@lo:104: 00010000:00010000:1.0:1789892579.422686:0:189428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884ffea00 already unused, calling callback (ffffffffc112ec20) 00000100:00100000:0.0:1789892579.422691:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 10000000:00010000:1.0:1789892579.422692:0:189428:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422699:0:193633:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.422701:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915978880:0@lo:104: 00010000:00010000:1.0:1789892579.422701:0:189428:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892579.422716:0:189428:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422720:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00010000:00010000:3.0:1789892579.422721:0:217564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801a00/0x5c4f93dd00213acf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213ac8 expref: 21 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892579.422739:0:189428:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892579.422749:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689d2e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979008:0@lo:104: 00010000:00010000:2.0:1789892579.422754:0:193633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892579.422760:0:193633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+3:217564:x1876834915980544:12345-0@lo:104: Request processed in 80us (285us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892579.422762:0:189428:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422763:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b551b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915980672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.422765:0:217564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837c00/0x5c4f93dd00213ac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213aba expref: 20 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422777:0:193633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00010000:00010000:1.0:1789892579.422784:0:189428:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892579.422792:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979136:0@lo:104: 00010000:00010000:1.0:1789892579.422795:0:189428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422801:0:193634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892579.422802:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892579.422808:0:217564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801c00/0x5c4f93dd00213ab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213aac expref: 19 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.422811:0:189428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213a82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a89 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422812:0:193634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422821:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789892579.422831:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b551ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915980288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892579.422836:0:193634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90688f800800 already unused, calling callback (ffffffffc112ec20) 00010000:00010000:1.0:1789892579.422838:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789892579.422841:0:193634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.422843:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892579.422848:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892579.422851:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979520:0@lo:104: 00000100:00100000:0.0:1789892579.422863:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892579.422868:0:193634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.422873:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688ebba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915979904:0@lo:104: 10000000:00010000:2.0:1789892579.422878:0:193634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892579.422884:0:193634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892579.422890:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069bcc91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915980160:0@lo:104: 00000100:00100000:0.0:1789892579.422898:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867136 00000100:00100000:0.0:1789892579.422902:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867136 00000100:00100000:1.0:1789892579.422906:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b551aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915979648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892579.422909:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885ebfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915980416:0@lo:104: 00010000:00010000:2.0:1789892579.422913:0:193634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422920:0:193634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892579.422921:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 10 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.422925:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915979392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892579.422929:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069af5b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217564:1876834915980544:0@lo:104: 00010000:00010000:2.0:1789892579.422932:0:193634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.422942:0:193634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213a74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c4f93dd00213a7b expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.422957:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867008 00000100:00100000:0.0:1789892579.422961:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867008 00010000:00010000:2.0:1789892579.422962:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892579.422965:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892579.422967:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915980928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892579.422969:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892579.422978:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892579.422989:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 11 pid: 189432 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.422999:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915980800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.423005:0:217564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.423005:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892579.423010:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980672 00000100:00100000:0.0:1789892579.423017:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980672 00000100:00100000:1.0:1789892579.423030:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b551b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915979264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892579.423037:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 19 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.423046:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892579.423053:0:200528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892579.423060:0:199151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980288 00000100:00100000:1.0:1789892579.423064:0:189424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980928 00000100:00100000:0.0:1789892579.423065:0:199151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980288 00000100:00100000:1.0:1789892579.423069:0:189424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980928 00000100:00100000:2.0:1789892579.423081:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915980032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892579.423082:0:199151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 21 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.423083:0:189426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915980800 00010000:00010000:1.0:1789892579.423088:0:189424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 21 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.423090:0:189426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915980800 00000100:00100000:2.0:1789892579.423100:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915979776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.423110:0:189426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 22 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.423113:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 597 00000100:00100000:0.0:1789892579.423127:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2399:x1876834925867136:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892579.423135:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892579.423136:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 598 00010000:00010000:0.0:1789892579.423142:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 11 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.423147:0:189424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1789892579.423155:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+11:2400:x1876834925867008:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892579.423162:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 11 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.423170:0:189424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688f477050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:3620:x1876834915980672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.423178:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892579.423185:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f800600/0x5c4f93dd00213af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6bc expref: 11 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423186:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 11 pid: 189432 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.423197:0:189424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892579.423211:0:189424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 22 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423215:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 10 pid: 189432 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892579.423234:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892579.423240:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688878f000/0x5c4f93dd00213af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6c3 expref: 10 pid: 189432 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.423243:0:189424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 22 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423262:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892579.423262:0:189424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837a00/0x5c4f93dd00213a97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a90 expref: 22 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892579.423270:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ae588d89-f458-4cef-8f6b-15cea35dd321+9:2399:x1876834925867136:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 145us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892579.423279:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 597 00010000:00010000:1.0:1789892579.423282:0:189424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892579.423295:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2400:x1876834925867008:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 145us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892579.423296:0:199151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1789892579.423317:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 598 00000100:00100000:0.0:1789892579.423323:0:199151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3620:x1876834915980288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892579.423331:0:199151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892579.423335:0:199151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 21 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.423341:0:189424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688f477050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3620:x1876834915980672:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892579.423345:0:189426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00010000:00010000:0.0:1789892579.423347:0:199151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 21 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.423361:0:189426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:3622:x1876834915980928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892579.423363:0:189424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00010000:00010000:0.0:1789892579.423368:0:199151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90688f801400/0x5c4f93dd00213aa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a9e expref: 21 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423378:0:189426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892579.423380:0:199151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892579.423388:0:189426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 19 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.423390:0:192465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00010000:00010000:3.0:1789892579.423400:0:189426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 19 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.423402:0:192465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3621:x1876834915980800:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892579.423414:0:199151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:3620:x1876834915980288:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (556us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892579.423419:0:192465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892579.423422:0:199151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00010000:00010000:2.0:1789892579.423428:0:192465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 19 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.423440:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b551ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915980288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892579.423449:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b551b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:784a6601-8373-4a3c-bbd0-38e03e19eb16:3620:1876834915980672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.423463:0:189426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990836e00/0x5c4f93dd00213a7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a74 expref: 18 pid: 189433 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.423465:0:192465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 18 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.423477:0:192465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906990837200/0x5c4f93dd00213a89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c4f93dd00213a82 expref: 17 pid: 189434 timeout: 3504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423478:0:189426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423508:0:189426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892579.423530:0:192465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892579.423536:0:189426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423545:0:189426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423552:0:189426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892579.423574:0:192465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:3621:x1876834915980800:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (534us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892579.423576:0:189426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423583:0:189426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff906884fff600 already unused, calling callback (ffffffffc0b48250) 00000100:00100000:2.0:1789892579.423583:0:192465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00010000:00010000:3.0:1789892579.423588:0:189426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892579.423589:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:784a6601-8373-4a3c-bbd0-38e03e19eb16:3621:1876834915980800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892579.423605:0:189426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423619:0:189426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.423629:0:217564:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892579.423630:0:189426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892579.423641:0:217564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892579.423650:0:217564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff906884fff600/0x5c4f93dd00213b00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892579.423666:0:189426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:3622:x1876834915980928:12345-0@lo:103:ldlm_bl.0 Request processed in 309us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892579.423673:0:189426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1789892579.423691:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:784a6601-8373-4a3c-bbd0-38e03e19eb16:3622:1876834915980928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892580.130645:0:190190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892580.239454:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892580.239554:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867392 00000100:00100000:3.0:1789892580.239570:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892580.239582:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867392 00000100:00100000:3.0:1789892580.239613:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892580.239653:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867264 00000100:00100000:1.0:1789892580.239657:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867520 00000100:00100000:1.0:1789892580.239669:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867520 00000100:00080000:2.0:1789892580.239675:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892580.239678:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867264 00000100:00080000:2.0:1789892580.239683:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892580.239688:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 520 00000100:00100000:3.0:1789892580.239719:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2401:x1876834925867392:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1789892580.239737:0:189439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 521 00000100:00100000:2.0:1789892580.239753:0:189439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+5:2402:x1876834925867520:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1789892580.239756:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2518 00000100:00100000:0.0:1789892580.239772:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2402:x1876834925867264:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1789892580.239792:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:2401:x1876834925867392:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.239799:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 520 00000100:00100000:2.0:1789892580.239806:0:189439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:082b2a23-8951-488c-926f-5ad884776d61+5:2402:x1876834925867520:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 58us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.239813:0:189439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 521 00000100:00100000:0.0:1789892580.239819:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+8:2402:x1876834925867264:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.239831:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2518 10000000:01000000:2.0:1789892580.706652:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892580.706660:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b6136000 from 193 10000000:01000000:2.0:1789892580.706664:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892580.706710:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.706721:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.706747:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.706769:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.706832:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.706883:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892580.706918:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981056 00000100:00100000:1.0:1789892580.706928:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981056 00000100:00100000:1.0:1789892580.707006:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:1.0:1789892580.707018:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+15:189436:x1876834915981056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892580.707032:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892580.707044:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688f801800/0x5c4f93dd00213b0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b07 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.707065:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688f801800/0x5c4f93dd00213b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b07 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.707075:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688f801800/0x5c4f93dd00213b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b07 expref: 16 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.707082:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688f801800, rc 0) 00000100:00100000:1.0:1789892580.707122:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915981056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892580.707127:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1789892580.707173:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892580.707186:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b0e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.707193:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b0e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.707247:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.707268:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.707286:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.707333:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981184 00000100:00100000:0.0:1789892580.707340:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981184 00000100:00100000:0.0:1789892580.707370:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1789892580.707377:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915981184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.707559:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915981184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.707566:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1789892580.707587:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.707612:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.707645:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.707666:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892580.707690:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981312 00000100:00100000:1.0:1789892580.707695:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981312 00000100:00100000:1.0:1789892580.707720:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:1.0:1789892580.707728:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915981312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.707805:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915981312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892580.707811:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:2.0:1789892580.707814:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.708122:0:217565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217565:1876834915981440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.708154:0:217565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.708170:0:217565:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b366c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.708199:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981440 00000100:00100000:0.0:1789892580.708204:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981440 00000100:00100000:0.0:1789892580.708226:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1789892580.708230:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217565:x1876834915981440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.708322:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217565:x1876834915981440:12345-0@lo:502:llog_process_th.0 Request processed in 91us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.708328:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1789892580.708352:0:217565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217565:1876834915981440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.708394:0:217565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217565:1876834915981568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.708419:0:217565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.708434:0:217565:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b366c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.708458:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981568 00000100:00100000:0.0:1789892580.708462:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981568 00000100:00100000:0.0:1789892580.708482:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:0.0:1789892580.708514:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217565:x1876834915981568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.708571:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:217565:x1876834915981568:12345-0@lo:502:llog_process_th.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.708576:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:1.0:1789892580.708618:0:217565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217565:1876834915981568:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892580.708640:0:217565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:2.0:1789892580.708724:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:2.0:1789892580.708743:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892580.708749:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b0e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.708762:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffe600/0x5c4f93dd00213b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b0e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892580.708768:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892580.708769:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 41 10000000:01000000:2.0:1789892580.708771:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892580.708784:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.708789:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.708794:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.708803:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.708824:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.708844:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.708861:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981696 00000100:00100000:0.0:1789892580.708875:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981696 00000100:00100000:0.0:1789892580.708894:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1789892580.708899:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+16:189436:x1876834915981696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892580.708905:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892580.708913:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836600/0x5c4f93dd00213b1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b15 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.708925:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836600/0x5c4f93dd00213b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b15 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.708937:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836600/0x5c4f93dd00213b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b15 expref: 17 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.708942:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836600, rc 0) 00000100:00100000:0.0:1789892580.708994:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915981696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.709002:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:2.0:1789892580.709012:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892580.709043:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b1c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.709051:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b1c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.709083:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.709108:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.709157:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.709184:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981824 00000100:00100000:0.0:1789892580.709189:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981824 00000100:00100000:0.0:1789892580.709219:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1789892580.709226:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915981824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.709328:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915981824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.709336:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1789892580.709344:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.709374:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.709407:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.709426:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.709468:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915981952 00000100:00100000:0.0:1789892580.709473:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915981952 00000100:00100000:0.0:1789892580.709548:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1789892580.709555:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915981952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.709636:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915981952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.709643:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1789892580.709662:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915981952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892580.710294:0:217566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 41 00000020:01000000:2.0:1789892580.710354:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 41-40 (rc=0) 10000000:01000000:2.0:1789892580.710370:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892580.710375:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b1c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.710380:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffe00/0x5c4f93dd00213b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b1c expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892580.710386:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892580.710387:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff906987a1b000 from 193 10000000:01000000:2.0:1789892580.710388:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892580.710399:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.710404:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.710410:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.710418:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.710444:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892580.710483:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982080 00000100:00100000:2.0:1789892580.710484:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.710521:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982080 00000100:00100000:0.0:1789892580.710546:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1789892580.710553:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+17:189436:x1876834915982080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892580.710565:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892580.710571:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836200/0x5c4f93dd00213b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b23 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.710582:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836200/0x5c4f93dd00213b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b23 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.710588:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836200/0x5c4f93dd00213b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b23 expref: 18 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.710593:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836200, rc 0) 00000100:00100000:0.0:1789892580.710620:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915982080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.710626:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1789892580.710637:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892580.710648:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b2a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.710654:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b2a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.710680:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.710700:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892580.710721:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982208 00000100:00100000:2.0:1789892580.710723:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.710725:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982208 00000100:00100000:0.0:1789892580.710746:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1789892580.710752:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915982208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.710805:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915982208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.710812:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1789892580.710818:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.710840:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.710867:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.710880:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.710885:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982336 00000100:00100000:0.0:1789892580.710889:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982336 00000100:00100000:0.0:1789892580.710909:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1789892580.710914:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915982336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.710992:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915982336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.711005:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.711012:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1789892580.711325:0:217567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217567:1876834915982464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.711361:0:217567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892580.711387:0:217567:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068890e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.711406:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982464 00000100:00100000:3.0:1789892580.711424:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982464 00000100:00100000:3.0:1789892580.711476:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1789892580.711522:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217567:x1876834915982464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.711654:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217567:x1876834915982464:12345-0@lo:502:llog_process_th.0 Request processed in 169us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.711664:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:0.0:1789892580.711664:0:217567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217567:1876834915982464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.711708:0:217567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217567:1876834915982592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.711735:0:217567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892580.711756:0:217567:0:(client.c:2702:ptlrpc_set_wait()) set ffff9068890e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892580.711767:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982592 00000100:00100000:1.0:1789892580.711772:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982592 00000100:00100000:1.0:1789892580.711798:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:1.0:1789892580.711804:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217567:x1876834915982592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.711882:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:217567:x1876834915982592:12345-0@lo:502:llog_process_th.0 Request processed in 70us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.711884:0:217567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217567:1876834915982592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.711897:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000040:00080000:0.0:1789892580.711905:0:217567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:2.0:1789892580.711957:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:2.0:1789892580.711990:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892580.711995:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b2a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.712001:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff800/0x5c4f93dd00213b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b2a expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892580.712007:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892580.712008:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 44 10000000:01000000:2.0:1789892580.712010:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892580.712028:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.712033:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.712039:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.712048:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.712070:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.712085:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.712145:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982720 00000100:00100000:3.0:1789892580.712151:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982720 00000100:00100000:3.0:1789892580.712184:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1789892580.712190:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+18:189436:x1876834915982720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892580.712198:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892580.712206:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f000/0x5c4f93dd00213b38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b31 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.712220:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f000/0x5c4f93dd00213b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b31 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.712227:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f000/0x5c4f93dd00213b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b31 expref: 19 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.712232:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f000, rc 0) 00000100:00100000:3.0:1789892580.712267:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915982720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.712273:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1789892580.712281:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892580.712294:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b38 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.712301:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b38 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.712330:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.712349:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.712364:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892580.712383:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982848 00000100:00100000:1.0:1789892580.712387:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982848 00000100:00100000:1.0:1789892580.712411:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:1.0:1789892580.712417:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915982848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.712480:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915982848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.712538:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.712547:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1789892580.712561:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.712593:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.712613:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.712633:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915982976 00000100:00100000:3.0:1789892580.712637:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915982976 00000100:00100000:3.0:1789892580.712659:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:3.0:1789892580.712666:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915982976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.712765:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915982976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.712773:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915982976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.712778:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000040:00080000:2.0:1789892580.713398:0:217568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 44 00000020:01000000:1.0:1789892580.713468:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 44-43 (rc=0) 10000000:01000000:1.0:1789892580.713521:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892580.713528:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b38 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.713542:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fff600/0x5c4f93dd00213b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b38 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892580.713548:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892580.713550:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90688228f800 from 193 10000000:01000000:1.0:1789892580.713552:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892580.713564:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.713570:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.713576:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892580.713586:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.713609:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.713632:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b36900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.713643:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983104 00000100:00100000:0.0:1789892580.713648:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983104 00000100:00100000:0.0:1789892580.713674:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:0.0:1789892580.713680:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+19:189436:x1876834915983104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892580.713686:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892580.713693:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990836400/0x5c4f93dd00213b46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b3f expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.713731:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990836400/0x5c4f93dd00213b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b3f expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.713738:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990836400/0x5c4f93dd00213b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b3f expref: 20 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.713743:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990836400, rc 0) 00000100:00100000:0.0:1789892580.713776:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9068853d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915983104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.713781:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1789892580.713802:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892580.713811:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b46 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.713817:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b46 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892580.713850:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.713881:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.713907:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b36900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.713931:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983232 00000100:00100000:3.0:1789892580.713937:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983232 00000100:00100000:3.0:1789892580.713963:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:3.0:1789892580.713968:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915983232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.714029:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90699b175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915983232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.714035:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1789892580.714060:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.714082:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.714109:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.714122:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b36900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.714139:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983360 00000100:00100000:0.0:1789892580.714146:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983360 00000100:00100000:0.0:1789892580.714176:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1789892580.714185:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915983360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.714245:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915983360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.714250:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1789892580.714268:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.714481:0:217569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217569:1876834915983488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.714547:0:217569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.714568:0:217569:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.714574:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983488 00000100:00100000:3.0:1789892580.714579:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983488 00000100:00100000:3.0:1789892580.714604:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1789892580.714610:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217569:x1876834915983488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.714687:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217569:x1876834915983488:12345-0@lo:502:llog_process_th.0 Request processed in 75us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.714697:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1789892580.714722:0:217569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217569:1876834915983488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.714756:0:217569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217569:1876834915983616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.714780:0:217569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.714793:0:217569:0:(client.c:2702:ptlrpc_set_wait()) set ffff906991b36900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.714847:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983616 00000100:00100000:0.0:1789892580.714853:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983616 00000100:00100000:0.0:1789892580.714881:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1789892580.714887:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217569:x1876834915983616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.714951:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:217569:x1876834915983616:12345-0@lo:502:llog_process_th.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.714958:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1789892580.714966:0:217569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217569:1876834915983616:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892580.714986:0:217569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:2.0:1789892580.715047:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:2.0:1789892580.715069:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892580.715075:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b46 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.715083:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800000/0x5c4f93dd00213b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b46 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892580.715089:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892580.715090:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 221 10000000:01000000:2.0:1789892580.715092:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892580.715109:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.715118:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.715128:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.715145:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.715186:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.715204:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.715235:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983744 00000100:00100000:3.0:1789892580.715242:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983744 00000100:00100000:3.0:1789892580.715271:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:3.0:1789892580.715297:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+20:189436:x1876834915983744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892580.715306:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892580.715323:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878ee00/0x5c4f93dd00213b54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b4d expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.715340:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878ee00/0x5c4f93dd00213b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b4d expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.715348:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878ee00/0x5c4f93dd00213b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b4d expref: 21 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.715380:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878ee00, rc 0) 00000100:00100000:3.0:1789892580.715453:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915983744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.715458:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1789892580.715482:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892580.715535:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b54 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.715542:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b54 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.715580:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.715600:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.715622:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.715634:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915983872 00000100:00100000:0.0:1789892580.715639:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915983872 00000100:00100000:0.0:1789892580.715664:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1789892580.715670:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915983872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.715753:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915983872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.715759:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1789892580.715762:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915983872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.715787:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.715814:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.715828:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.715851:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984000 00000100:00100000:3.0:1789892580.715855:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984000 00000100:00100000:3.0:1789892580.715876:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:3.0:1789892580.715882:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915984000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.715945:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915984000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.715951:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.715952:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:2.0:1789892580.716139:0:217570:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217570:1876834915984128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892580.716172:0:217570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.716186:0:217570:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.716211:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984128 00000100:00100000:0.0:1789892580.716216:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984128 00000100:00100000:0.0:1789892580.716242:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:0.0:1789892580.716256:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217570:x1876834915984128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.716353:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217570:x1876834915984128:12345-0@lo:502:llog_process_th.0 Request processed in 96us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.716361:0:217570:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217570:1876834915984128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.716362:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000020:01000000:2.0:1789892580.716391:0:217570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892580.716402:0:217570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892580.716404:0:217570:0:(obd_config.c:1561:class_process_config()) marker 212 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892580.716410:0:217570:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789892580.716426:0:217570:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 1 00000100:00100000:2.0:1789892580.716459:0:217570:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217570:1876834915984256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892580.716552:0:217570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.716583:0:217570:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.716598:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984256 00000100:00100000:3.0:1789892580.716605:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984256 00000100:00100000:3.0:1789892580.716634:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1789892580.716641:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217570:x1876834915984256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.716742:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217570:x1876834915984256:12345-0@lo:502:llog_process_th.0 Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.716746:0:217570:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217570:1876834915984256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.716757:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1789892580.716778:0:217570:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217570:1876834915984384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892580.716812:0:217570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.716825:0:217570:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.716841:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984384 00000100:00100000:0.0:1789892580.716846:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984384 00000100:00100000:0.0:1789892580.716869:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1789892580.716878:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217570:x1876834915984384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.716941:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:217570:x1876834915984384:12345-0@lo:502:llog_process_th.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.716947:0:217570:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217570:1876834915984384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.716948:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000020:01000000:2.0:1789892580.716971:0:217570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892580.716976:0:217570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892580.716977:0:217570:0:(obd_config.c:1561:class_process_config()) marker 212 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892580.716980:0:217570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 225 count 220 00000020:01000000:1.0:1789892580.717033:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 221-224 (rc=0) 10000000:01000000:1.0:1789892580.717050:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892580.717054:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b54 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.717061:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884ffea00/0x5c4f93dd00213b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b54 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892580.717067:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892580.717068:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9069b84c6000 from 193 10000000:01000000:1.0:1789892580.717075:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892580.717088:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.717094:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.717100:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892580.717109:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.717130:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.717145:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.717164:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984512 00000100:00100000:3.0:1789892580.717170:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984512 00000100:00100000:3.0:1789892580.717191:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:3.0:1789892580.717196:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+21:189436:x1876834915984512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892580.717202:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892580.717209:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878f800/0x5c4f93dd00213b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b5b expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.717229:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878f800/0x5c4f93dd00213b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b5b expref: 22 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.717247:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878f800/0x5c4f93dd00213b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b5b expref: 22 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892580.717252:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878f800, rc 0) 00000100:00100000:3.0:1789892580.717281:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915984512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.717285:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1789892580.717307:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892580.717318:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b62 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.717324:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b62 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892580.717352:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.717372:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.717385:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.717407:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984640 00000100:00100000:0.0:1789892580.717412:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984640 00000100:00100000:0.0:1789892580.717436:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1789892580.717441:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915984640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.717555:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915984640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.717562:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:1.0:1789892580.717566:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.717594:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.717622:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.717646:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.717655:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984768 00000100:00100000:3.0:1789892580.717660:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984768 00000100:00100000:3.0:1789892580.717688:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1789892580.717698:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915984768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.717784:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b248e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915984768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.717789:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1789892580.717808:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915984768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.717996:0:217571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217571:1876834915984896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.718031:0:217571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.718049:0:217571:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.718098:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915984896 00000100:00100000:0.0:1789892580.718105:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915984896 00000100:00100000:0.0:1789892580.718139:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1789892580.718149:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217571:x1876834915984896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.718235:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217571:x1876834915984896:12345-0@lo:502:llog_process_th.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.718241:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:1.0:1789892580.718254:0:217571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217571:1876834915984896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.718295:0:217571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217571:1876834915985024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892580.718350:0:217571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.718369:0:217571:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.718421:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985024 00000100:00100000:3.0:1789892580.718427:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985024 00000100:00100000:3.0:1789892580.718455:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1789892580.718460:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217571:x1876834915985024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.718583:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:217571:x1876834915985024:12345-0@lo:502:llog_process_th.0 Request processed in 122us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.718607:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:1.0:1789892580.718620:0:217571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217571:1876834915985024:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892580.718649:0:217571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:2.0:1789892580.718731:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:2.0:1789892580.718750:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892580.718755:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b62 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.718763:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f800800/0x5c4f93dd00213b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b62 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892580.718768:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892580.718769:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 221 10000000:01000000:2.0:1789892580.718771:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892580.718782:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.718787:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.718793:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.718802:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.718822:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.718848:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.718891:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985152 00000100:00100000:0.0:1789892580.718902:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985152 00000100:00100000:0.0:1789892580.718930:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1789892580.718936:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+22:189436:x1876834915985152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892580.718943:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892580.718950:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837800/0x5c4f93dd00213b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b69 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.718961:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837800/0x5c4f93dd00213b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b69 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.718967:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837800/0x5c4f93dd00213b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b69 expref: 23 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.718972:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837800, rc 0) 00000100:00100000:0.0:1789892580.719004:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915985152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.719009:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1789892580.719014:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892580.719026:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b70 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892580.719032:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b70 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892580.719058:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.719077:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.719090:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.719112:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985280 00000100:00100000:3.0:1789892580.719116:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985280 00000100:00100000:3.0:1789892580.719141:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1789892580.719145:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915985280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.719201:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915985280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.719207:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1789892580.719211:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.719235:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892580.719265:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.719279:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.719296:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985408 00000100:00100000:0.0:1789892580.719301:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985408 00000100:00100000:0.0:1789892580.719322:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1789892580.719328:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915985408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.719405:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915985408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892580.719407:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892580.719421:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1789892580.719649:0:217572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217572:1876834915985536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892580.719679:0:217572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.719715:0:217572:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.719734:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985536 00000100:00100000:3.0:1789892580.719740:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985536 00000100:00100000:3.0:1789892580.719764:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1789892580.719772:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217572:x1876834915985536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.719841:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217572:x1876834915985536:12345-0@lo:502:llog_process_th.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.719846:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1789892580.719849:0:217572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217572:1876834915985536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892580.719884:0:217572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892580.719889:0:217572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892580.719891:0:217572:0:(obd_config.c:1561:class_process_config()) marker 211 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892580.719894:0:217572:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789892580.719901:0:217572:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 1 00000100:00100000:2.0:1789892580.720225:0:217572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217572:1876834915985664:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789892580.720232:0:217573:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9069b84c6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892580.720238:0:217573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9069b84c6000 4 00000100:00100000:2.0:1789892580.720261:0:217572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.720275:0:217572:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.720301:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985664 00000100:00100000:0.0:1789892580.720307:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985664 00000100:00100000:0.0:1789892580.720337:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1789892580.720343:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217572:x1876834915985664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892580.720444:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217572:x1876834915985664:12345-0@lo:502:llog_process_th.0 Request processed in 99us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.720451:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:2.0:1789892580.720455:0:217572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217572:1876834915985664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892580.720556:0:217572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217572:1876834915985792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892580.720595:0:217572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892580.720628:0:217572:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.720663:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985792 00000100:00100000:3.0:1789892580.720668:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985792 00000100:00100000:3.0:1789892580.720699:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1789892580.720724:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217572:x1876834915985792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892580.720792:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:217572:x1876834915985792:12345-0@lo:502:llog_process_th.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892580.720798:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:2.0:1789892580.720800:0:217572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:784a6601-8373-4a3c-bbd0-38e03e19eb16:217572:1876834915985792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892580.720824:0:217572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892580.720828:0:217572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892580.720830:0:217572:0:(obd_config.c:1561:class_process_config()) marker 211 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892580.720833:0:217572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 225 count 220 00000020:01000000:1.0:1789892580.720886:0:189436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 221-224 (rc=0) 10000000:01000000:1.0:1789892580.720903:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892580.720909:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b70 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.720918:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff906884fffa00/0x5c4f93dd00213b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b70 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892580.720927:0:189436:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892580.720929:0:189436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff906886f219c0 from 1 10000000:01000000:1.0:1789892580.720931:0:189436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892580.720947:0:189436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.720955:0:189436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.720970:0:189436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892580.720985:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.721014:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.721033:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892580.721083:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915985920 00000100:00100000:0.0:1789892580.721090:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915985920 00000100:00100000:0.0:1789892580.721144:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1789892580.721153:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+23:189436:x1876834915985920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892580.721163:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892580.721173:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837600/0x5c4f93dd00213b7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c4f93dd00213b77 expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.721190:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837600/0x5c4f93dd00213b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c4f93dd00213b77 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.721197:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837600/0x5c4f93dd00213b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c4f93dd00213b77 expref: 24 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892580.721202:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837600, rc 0) 00000100:00100000:0.0:1789892580.721236:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915985920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892580.721241:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1789892580.721271:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915985920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892580.721285:0:189436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b7e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.721295:0:189436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c4f93dd00213b7e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892580.721335:0:189436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915986048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892580.721365:0:189436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892580.721385:0:189436:0:(client.c:2702:ptlrpc_set_wait()) set ffff906987287540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892580.721439:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986048 00000100:00100000:3.0:1789892580.721445:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986048 00000100:00100000:3.0:1789892580.721472:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1789892580.721478:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915986048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892580.721566:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:189436:x1876834915986048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (200us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892580.721573:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1789892580.721586:0:189436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:784a6601-8373-4a3c-bbd0-38e03e19eb16:189436:1876834915986048:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789892580.721619:0:189436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892580.721626:0:189436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b7e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892580.721635:0:189436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff90688f801c00/0x5c4f93dd00213b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c4f93dd00213b7e expref: -99 pid: 189436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892581.154679:0:189428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892581.391537:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892581.391594:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867648 00000100:00100000:0.0:1789892581.391604:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867648 00000100:00100000:0.0:1789892581.391652:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2559 00000100:00100000:0.0:1789892581.391662:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+8:191725:x1876834925867648:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892581.391676:0:189434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892581.391692:0:189434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff906990837000/0x5c4f93dd00213b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6ca expref: -99 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892581.391729:0:189434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff906990837000/0x5c4f93dd00213b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ca expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892581.391738:0:189434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff906990837000/0x5c4f93dd00213b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6ca expref: 9 pid: 189434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892581.391745:0:189434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff906990837000, rc 0) 00000100:00100000:0.0:1789892581.391793:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b62ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925867648:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 134us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892581.391798:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2559 00000100:00100000:2.0:1789892581.392605:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892581.392641:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867776 00000100:00100000:3.0:1789892581.392647:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867776 00000100:00100000:3.0:1789892581.392673:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2560 00000100:00100000:3.0:1789892581.392679:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925867776:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892581.392778:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925867776:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 99us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892581.392784:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2560 00000100:00100000:3.0:1789892581.393453:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892581.393513:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925867904 00000100:00100000:0.0:1789892581.393517:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925867904 00000100:00100000:0.0:1789892581.393550:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2561 00000100:00100000:0.0:1789892581.393563:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925867904:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892581.393639:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925867904:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892581.393645:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2561 00000100:00100000:2.0:1789892581.394641:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892581.394709:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868032 00000100:00100000:3.0:1789892581.394714:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868032 00000100:00100000:3.0:1789892581.394739:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2562 00000100:00100000:3.0:1789892581.394745:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215783:x1876834925868032:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892581.394824:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215783:x1876834925868032:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892581.394830:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2562 00000100:00100000:2.0:1789892581.395525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892581.395572:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868160 00000100:00100000:0.0:1789892581.395577:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868160 00000100:00100000:0.0:1789892581.395603:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2563 00000100:00100000:0.0:1789892581.395609:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215783:x1876834925868160:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892581.395683:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+9:215783:x1876834925868160:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892581.395690:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2563 00000100:00100000:0.0:1789892581.396686:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892581.396735:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868288 00000100:00100000:3.0:1789892581.396741:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868288 00000100:00100000:3.0:1789892581.396823:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2564 00000100:00100000:3.0:1789892581.396833:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+9:191725:x1876834925868288:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892581.396842:0:189432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892581.396851:0:189432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90688878e000/0x5c4f93dd00213b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x44de11c4f5e8a6d1 expref: -99 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892581.396866:0:189432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90688878e000/0x5c4f93dd00213b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6d1 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892581.396873:0:189432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90688878e000/0x5c4f93dd00213b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0x44de11c4f5e8a6d1 expref: 10 pid: 189432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892581.396885:0:189432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90688878e000, rc 0) 00000100:00100000:3.0:1789892581.396913:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925868288:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892581.396921:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2564 00000100:00100000:2.0:1789892581.397558:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892581.397611:0:189434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868416 00000100:00100000:0.0:1789892581.397617:0:189434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868416 00000100:00100000:0.0:1789892581.397649:0:189434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2565 00000100:00100000:0.0:1789892581.397655:0:189434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925868416:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892581.397708:0:189434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae588d89-f458-4cef-8f6b-15cea35dd321+10:191725:x1876834925868416:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 53us (153us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892581.397714:0:189434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2565 00000100:00100000:2.0:1789892581.757725:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1789892581.757780:0:191135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868544 00000100:00100000:1.0:1789892581.757796:0:191135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868544 00000100:00100000:1.0:1789892581.757851:0:191135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2819 00000100:00100000:1.0:1789892581.757861:0:191135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:215803:x1876834925868544:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:2.0:1789892581.759257:0:191135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:191135:1876834915986176:0@lo:19:mdt00_003.0 00000100:00100000:2.0:1789892581.759308:0:191135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892581.759336:0:191135:0:(client.c:2702:ptlrpc_set_wait()) set ffff90688dbdcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892581.759358:0:190945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986176 00000100:00100000:2.0:1789892581.759362:0:190945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986176 00000100:00100000:2.0:1789892581.759404:0:190945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789892581.759412:0:190945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:191135:x1876834915986176:12345-0@lo:19:mdt00_003.0 00000100:00080000:0.0:1789892581.759566:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892581.759619:0:190945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:191135:x1876834915986176:12345-0@lo:19:mdt00_003.0 Request processed in 208us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892581.759636:0:190945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789892581.759689:0:191135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:191135:1876834915986176:0@lo:19:mdt00_003.0 00000100:00100000:2.0:1789892581.759754:0:191135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:082b2a23-8951-488c-926f-5ad884776d61+6:215803:x1876834925868544:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1895us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892581.759760:0:191135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2819 00000100:00100000:3.0:1789892581.760644:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1789892581.760672:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868672 00000100:00100000:0.0:1789892581.760678:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868672 00000100:00100000:0.0:1789892581.760714:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2820 00000100:00100000:0.0:1789892581.760725:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069bcc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:215803:x1876834925868672:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:2.0:1789892581.762300:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069bcc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:082b2a23-8951-488c-926f-5ad884776d61+6:215803:x1876834925868672:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 1576us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892581.762308:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2820 00010000:00010000:1.0:1789892582.178619:0:193634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892582.178633:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915986304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892582.178697:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892582.178738:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986304 00000100:00100000:1.0:1789892582.178745:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986304 00000100:00100000:1.0:1789892582.178793:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789892582.178803:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915986304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892582.178832:0:189444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892582.178883:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906882607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876834915986304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892582.178890:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789892582.178928:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1876834915986304:0@lo:41:osp-pre-1-0.0 00000004:00080000:0.0:1789892582.583033:0:217722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3407731539047ns, next at 3277500567060ns, rc = 0 00080000:00080000:0.0:1789892582.583053:0:217722:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892582.583152:0:217722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3407731660767ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892582.583159:0:217722:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789892582.583243:0:217722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3407731752020ns, next at 3206864919340ns, rc = 0 00080000:00080000:0.0:1789892582.583248:0:217722:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892582.583335:0:217722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3407731842500ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892582.583346:0:217722:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789892582.583754:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000004:00080000:3.0:1789892582.583788:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 38 committed 00000004:00080000:2.0:1789892582.584127:0:189419:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000004:00080000:2.0:1789892582.584285:0:190171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 38 committed 00000100:00100000:2.0:1789892582.690717:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915986432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892582.690786:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892582.690823:0:190179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986432 00000100:00100000:1.0:1789892582.690833:0:190179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986432 00000100:00100000:1.0:1789892582.690880:0:190179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789892582.690889:0:190179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069847a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915986432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789892582.690919:0:190179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:1.0:1789892582.690965:0:190179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069847a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915986432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892582.690971:0:190179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789892582.691001:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915986432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892583.034421:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892583.034478:0:189438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868800 00000100:00100000:3.0:1789892583.034488:0:189438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868800 00000100:00080000:0.0:1789892583.034550:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892583.034573:0:189438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2821 00000100:00100000:3.0:1789892583.034584:0:189438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:215993:x1876834925868800:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892583.034690:0:189438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:082b2a23-8951-488c-926f-5ad884776d61+6:215993:x1876834925868800:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892583.034696:0:189438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2821 00000100:00100000:0.0:1789892583.045094:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1789892583.045143:0:189440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834925868928 00000100:00100000:3.0:1789892583.045153:0:189440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834925868928 00000100:00100000:3.0:1789892583.045213:0:189440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 2822 00000100:00100000:3.0:1789892583.045226:0:189440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:215995:x1876834925868928:12345-192.168.204.33@tcp:48:lfs.0 00000100:00100000:3.0:1789892583.045331:0:189440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:082b2a23-8951-488c-926f-5ad884776d61+6:215995:x1876834925868928:12345-192.168.204.33@tcp:48:lfs.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892583.045340:0:189440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 2822 00000100:00100000:1.0:1789892583.202696:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915986816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892583.202696:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915986560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789892583.202757:0:189427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892583.202780:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892583.202800:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915987072:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.202811:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915987200:0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.202832:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90688d40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915986688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892583.202852:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892583.202853:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986816 00000100:00100000:2.0:1789892583.202860:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986816 00000100:00100000:1.0:1789892583.202882:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892583.202886:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892583.202912:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906998c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915987584:0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.202919:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915987328:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.202920:0:192977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986688 00000100:00100000:2.0:1789892583.202924:0:192977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986688 00000100:00100000:3.0:1789892583.202929:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915987712:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.202951:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789892583.202958:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892583.202966:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915986816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892583.202976:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892583.202978:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892583.202988:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915988096:0@lo:400:kworker.0 00002000:00000024:2.0:1789892583.203001:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892583.203015:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1876834915988224:0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.203020:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915987840:0@lo:400:kworker.0 00000100:00100000:0.0:1789892583.203025:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892583.203057:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915988608:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203068:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915986816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892583.203077:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892583.203078:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892583.203086:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789892583.203109:0:192977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789892583.203111:0:190942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987328 00000100:00100000:0.0:1789892583.203117:0:190942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987328 00000100:00100000:2.0:1789892583.203123:0:192977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915986688:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892583.203126:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1876834915988352:0@lo:400:kworker.0 00002000:00000024:2.0:1789892583.203147:0:192977:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892583.203153:0:189432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987072 00000100:00100000:1.0:1789892583.203159:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892583.203161:0:189432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987072 00000100:00100000:0.0:1789892583.203163:0:190942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987840 00000100:00100000:0.0:1789892583.203169:0:190942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987840 00000100:00100000:2.0:1789892583.203197:0:192977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915986688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892583.203206:0:190942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789892583.203211:0:192977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789892583.203218:0:189432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1789892583.203218:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069b5518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915986816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892583.203220:0:190942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069af9ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915987328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.203237:0:189432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915987072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203248:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987584 00000100:00100000:1.0:1789892583.203248:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90688d40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915986688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892583.203256:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987584 00000100:00100000:0.0:1789892583.203266:0:190942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069af9ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915987328:12345-0@lo:400:kworker.0 Request processed in 48us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892583.203275:0:190942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789892583.203283:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915987328:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.203297:0:189432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906984772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:784a6601-8373-4a3c-bbd0-38e03e19eb16+24:3619:x1876834915987072:12345-0@lo:400:kworker.0 Request processed in 63us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892583.203298:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789892583.203310:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915988096 00000100:00100000:1.0:1789892583.203312:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915987456:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.203314:0:189432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1789892583.203317:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915988096 00000100:00100000:2.0:1789892583.203348:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915988224 00000100:00100000:2.0:1789892583.203354:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915988224 00000100:00100000:1.0:1789892583.203354:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892583.203384:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915988352 00000100:00100000:1.0:1789892583.203385:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915987968:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.203387:0:191136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987456 00000100:00100000:2.0:1789892583.203388:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915988352 00000100:00100000:3.0:1789892583.203397:0:191136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987456 00000100:00100000:2.0:1789892583.203428:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1789892583.203429:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892583.203455:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789892583.203461:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915987584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.203465:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff906883697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915988480:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.203473:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915987840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.203538:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892583.203547:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876834915987584:12345-0@lo:400:kworker.0 Request processed in 89us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.203557:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1789892583.203570:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915987840:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.203574:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915987840:12345-0@lo:400:kworker.0 Request processed in 104us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.203578:0:191771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915988480 00000100:00100000:2.0:1789892583.203583:0:191771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915988480 00000100:00100000:3.0:1789892583.203589:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789892583.203606:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1789892583.203606:0:190942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987968 00000100:00100000:0.0:1789892583.203612:0:190942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987968 00000100:00100000:3.0:1789892583.203617:0:191136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789892583.203623:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90688d40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915988096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203627:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1789892583.203634:0:191136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915987456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892583.203645:0:190942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789892583.203646:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3620:x1876834915988224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892583.203662:0:190942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b551b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915987968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.203671:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90688d40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876834915988096:12345-0@lo:400:kworker.0 Request processed in 57us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892583.203679:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1789892583.203705:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789892583.203706:0:191136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876834915987456:12345-0@lo:400:kworker.0 Request processed in 73us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.203714:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3620:x1876834915988224:12345-0@lo:400:kworker.0 Request processed in 74us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892583.203717:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876834915988352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892583.203723:0:190942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b551b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876834915987968:12345-0@lo:400:kworker.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892583.203727:0:191136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789892583.203737:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1789892583.203741:0:190942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789892583.203760:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876834915988352:12345-0@lo:400:kworker.0 Request processed in 47us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.203768:0:191771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789892583.203773:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892583.203775:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987200 00000100:00100000:0.0:1789892583.203779:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987200 00000100:00100000:1.0:1789892583.203786:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1789892583.203787:0:191771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9069b5519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915988480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.203808:0:196796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915988608 00000100:00100000:1.0:1789892583.203813:0:196796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915988608 00000100:00100000:0.0:1789892583.203815:0:189444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915987712 00000100:00100000:0.0:1789892583.203819:0:189444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915987712 00000100:00100000:3.0:1789892583.203826:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:784a6601-8373-4a3c-bbd0-38e03e19eb16:3619:1876834915987072:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203838:0:191771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9069b5519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876834915988480:12345-0@lo:400:kworker.0 Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892583.203843:0:196796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1789892583.203843:0:189444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789892583.203850:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906998c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876834915987584:0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.203858:0:196796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915988608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892583.203858:0:189444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915987200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203862:0:191771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789892583.203872:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876834915988096:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203902:0:189443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789892583.203911:0:196796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876834915988608:12345-0@lo:400:kworker.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.203917:0:189443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915987712:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789892583.203920:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906883694700 x1876834915988608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892583.203924:0:189444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876834915987200:12345-0@lo:400:kworker.0 Request processed in 70us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892583.203926:0:196796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1789892583.203943:0:189444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789892583.203949:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1876834915988608:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.203979:0:189443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876834915987712:12345-0@lo:400:kworker.0 Request processed in 65us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.203989:0:189443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789892583.204017:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1876834915987456:0@lo:400:kworker.0 00000100:00080000:3.0:1789892583.204019:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892583.204028:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789892583.204034:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789892583.204038:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9068886b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1876834915987968:0@lo:400:kworker.0 00000100:00080000:3.0:1789892583.204041:0:189435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892583.204057:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1876834915987200:0@lo:400:kworker.0 00000100:00100000:0.0:1789892583.204061:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1876834915988480:0@lo:400:kworker.0 00000100:00100000:3.0:1789892583.204069:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892583.204093:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90689ae87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1876834915987712:0@lo:400:kworker.0 00010000:00080000:0.0:1789892583.204094:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff906883695f80 x1876834915988352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892583.204108:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915986944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892583.204115:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1876834915988352:0@lo:400:kworker.0 00000100:00100000:2.0:1789892583.204123:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906883695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1876834915988224:0@lo:400:kworker.0 00000100:00100000:1.0:1789892583.204129:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986560 00000100:00100000:1.0:1789892583.204135:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986560 00000100:00100000:3.0:1789892583.204150:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892583.204181:0:214920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834915986944 00000100:00100000:1.0:1789892583.204186:0:214920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834915986944 00000100:00100000:2.0:1789892583.204191:0:190946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789892583.204202:0:190946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915986560:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892583.204218:0:214920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00002000:00000024:2.0:1789892583.204219:0:190946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892583.204234:0:214920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff906885315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915986944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789892583.204249:0:214920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892583.204260:0:190946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1876834915986560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892583.204265:0:190946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789892583.204288:0:214920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff906885315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1876834915986944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892583.204295:0:214920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789892583.204323:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff906885317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1876834915986560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892583.204341:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9069847a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1876834915986944:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789892583.532068:0:217818:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_72: @@@@@@ FAIL: Used space(10240) for user quota_usr isn't 0. Debug log: 10307 lines, 10307 kept, 0 dropped, 0 bad.