00000100:00100000:0.0F:1789896045.997328:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003568640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789896045.997409:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1789896045.997453:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568640 00000100:00100000:3.0:1789896045.997468:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568640 00000100:00100000:3.0:1789896045.997527:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789896045.997537:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a946819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003568640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789896045.997572:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789896045.997635:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a946819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003568640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896045.997643:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789896045.997668:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003568640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789896046.573305:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1789896047.020413:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003568896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789896047.020500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896047.020535:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003568768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789896047.020550:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568896 00000100:00100000:0.0:1789896047.020559:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568896 00000100:00100000:1.0:1789896047.020564:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789896047.020617:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0F:1789896047.020632:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568768 00000100:00100000:0.0:1789896047.020639:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789896047.020646:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568768 00000100:00100000:0.0:1789896047.020656:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003568896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789896047.020690:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896047.020701:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789896047.020710:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003568768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789896047.020739:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:0.0:1789896047.020747:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003568896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896047.020755:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789896047.020774:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003568896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896047.020788:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003568768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896047.020794:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003568768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896047.020801:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000020:00000080:2.0:1789896047.369373:0:215087:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff06ded530 20000000:00000080:2.0:1789896047.369387:0:215087:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa65fa6c00 uarg=0000000000000000 00000040:00100000:2.0:1789896047.369824:0:215087:0:(llog.c:1072:llog_reverse_process()) index 173 : idx 137 20000000:01000000:2.0:1789896047.369830:0:215087:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 163 cmd:0xce021 lustre.qpool1 lustre-OST0000_UUID 20000000:01000000:2.0:1789896047.369847:0:215087:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:2.0:1789896047.370096:0:215088:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 176 1->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:2.0:1789896047.370139:0:215088:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 164 marker 176 2->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789896047.370150:0:215088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000040:00080000:1.0:1789896047.370304:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].174, 224 off40008 20000000:01000000:1.0:1789896047.370319:0:215087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789896047.370336:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].175, 128 off40136 00000040:00080000:1.0:1789896047.370356:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].176, 224 off40360 20000000:01000000:1.0:1789896047.370374:0:215087:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:2.0:1789896047.370569:0:215089:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 188 marker 177 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:2.0:1789896047.370590:0:215089:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 190 marker 177 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789896047.370607:0:215089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 200 count 196 00000040:00080000:1.0:1789896047.370710:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].200, 224 off44816 20000000:01000000:1.0:1789896047.370721:0:215087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789896047.370737:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].201, 136 off44952 00000040:00080000:1.0:1789896047.370758:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].202, 224 off45176 20000000:01000000:1.0:1789896047.370770:0:215087:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:2.0:1789896047.371080:0:215090:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 188 marker 178 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:2.0:1789896047.371105:0:215090:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 190 marker 178 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789896047.371121:0:215090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 200 count 196 00000040:00080000:1.0:1789896047.371235:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].200, 224 off44816 20000000:01000000:1.0:1789896047.371246:0:215087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789896047.371262:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].201, 136 off44952 00000040:00080000:1.0:1789896047.371274:0:215087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].202, 224 off45176 10000000:01000000:1.0:1789896047.371282:0:215087:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789896047.371299:0:215087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371313:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371318:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371330:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371334:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371337:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371341:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24be expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371344:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371348:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24da expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371351:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371357:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371363:0:215087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371370:0:215087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371419:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371432:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 9 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.371451:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569024:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896047.371536:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371546:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.371555:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569152:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896047.371600:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371609:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 23 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.371619:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569280:0@lo:104: 00000100:00100000:1.0:1789896047.371660:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896047.371696:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a24da expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371704:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a24da expref: 23 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.371705:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003569280 00000100:00100000:0.0:1789896047.371715:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003569280 00000100:00100000:1.0:1789896047.371726:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569408:0@lo:104: 00000100:00100000:1.0:1789896047.371756:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896047.371778:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003569408 00000100:00100000:0.0:1789896047.371783:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003569408 00000100:00100000:2.0:1789896047.371797:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00010000:00010000:1.0:1789896047.371800:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371812:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 23 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.371814:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569280:12345-0@lo:104: 00000100:00100000:0.0:1789896047.371820:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789896047.371832:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569536:0@lo:104: 00010000:00010000:2.0:1789896047.371835:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.371835:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569408:12345-0@lo:104: 00010000:00010000:0.0:1789896047.371849:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.371860:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896047.371883:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a24be expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.371892:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a24be expref: 23 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.371902:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569664:0@lo:104: 00010000:00010000:2.0:1789896047.371913:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789896047.371921:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896047.371923:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003569536 00000100:00100000:2.0:1789896047.371930:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569280:12345-0@lo:104: Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896047.371931:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003569536 00000100:00100000:0.0:1789896047.371931:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569408:12345-0@lo:104: Request processed in 98us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896047.371933:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896047.371947:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1789896047.371953:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00010000:00010000:1.0:1789896047.371961:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.371980:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003569664 00010000:00010000:1.0:1789896047.371985:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 23 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.371986:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003569664 00010000:00010000:0.0:1789896047.371993:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789896047.371999:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569792:0@lo:104: 00010000:00010000:0.0:1789896047.372001:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.372010:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1789896047.372021:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00010000:00010000:0.0:1789896047.372025:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896047.372031:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372036:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569664:12345-0@lo:104: 00000100:00100000:1.0:1789896047.372045:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896047.372046:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372051:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896047.372059:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896047.372066:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896047.372070:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.372093:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 23 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372097:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372098:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789896047.372105:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569920:0@lo:104: 00000100:00100000:3.0:1789896047.372108:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569536:12345-0@lo:104: 00000100:00100000:2.0:1789896047.372112:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003569664:12345-0@lo:104: Request processed in 78us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896047.372113:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896047.372124:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372125:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:0.0:1789896047.372140:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372150:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372151:0:189482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789896047.372152:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.372173:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 23 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372176:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896047.372181:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789896047.372184:0:189482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896047.372184:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372190:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003570176:0@lo:104: 00000100:00100000:3.0:1789896047.372192:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215087:x1876838003569536:12345-0@lo:104: Request processed in 169us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896047.372222:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003569792 00000100:00100000:2.0:1789896047.372227:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003569792 00010000:00010000:0.0:1789896047.372230:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b000 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896047.372237:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.372242:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1789896047.372249:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896047.372258:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003569920 00010000:00010000:0.0:1789896047.372261:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372263:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003569920 00000100:00100000:3.0:1789896047.372267:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570176 00000100:00100000:3.0:1789896047.372274:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570176 10000000:00010000:0.0:1789896047.372275:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896047.372283:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896047.372286:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372289:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00010000:00010000:1.0:1789896047.372300:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 23 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372303:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9529a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215087:x1876838003569792:12345-0@lo:104: 00010000:00010000:0.0:1789896047.372305:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.372309:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00010000:00010000:2.0:1789896047.372319:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372320:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896047.372323:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003570304:0@lo:104: 00000100:00100000:3.0:1789896047.372326:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215087:x1876838003569920:12345-0@lo:104: 00010000:00010000:0.0:1789896047.372341:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372342:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372360:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372364:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896047.372377:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896047.372379:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789896047.372381:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372389:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9529a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215087:x1876838003569792:12345-0@lo:104: Request processed in 89us (347us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896047.372392:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896047.372399:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372401:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789896047.372403:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1789896047.372414:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215087:x1876838003569920:12345-0@lo:104: Request processed in 91us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896047.372415:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896047.372423:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.372436:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 10000000:01000000:0.0:1789896047.372442:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896047.372448:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570304 00000100:00100000:2.0:1789896047.372453:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570304 00010000:00010000:0.0:1789896047.372460:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.372465:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00010000:00010000:0.0:1789896047.372472:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896047.372478:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003570176:12345-0@lo:104: 00010000:00010000:0.0:1789896047.372481:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372485:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00010000:00010000:3.0:1789896047.372492:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372495:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.372498:0:215087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372501:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003570304:12345-0@lo:104: 00010000:00010000:2.0:1789896047.372520:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.372524:0:215087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 23 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372537:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789896047.372542:0:215087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003570560:0@lo:104: 00010000:00010000:0.0:1789896047.372542:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372546:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789896047.372557:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a600 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:3.0:1789896047.372558:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003570176:12345-0@lo:104: Request processed in 81us (308us total) trans 0 rc 0/0 10000000:00010000:0.0:1789896047.372564:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372569:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789896047.372571:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1789896047.372582:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215087:x1876838003570304:12345-0@lo:104: Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896047.372583:0:215087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896047.372583:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896047.372598:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372601:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789896047.372609:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 10000000:01000000:0.0:1789896047.372610:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896047.372611:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372621:0:215087:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45121c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789896047.372623:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ba00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896047.372629:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372630:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570560 00010000:00010000:0.0:1789896047.372630:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372636:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570560 00010000:00010000:0.0:1789896047.372648:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896047.372650:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569280:0@lo:104: 00010000:00010000:3.0:1789896047.372651:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372656:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 10000000:00010000:3.0:1789896047.372669:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372669:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215087:x1876838003570560:12345-0@lo:104: 00010000:00010000:0.0:1789896047.372669:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372672:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569408:0@lo:104: 00010000:00010000:2.0:1789896047.372683:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372691:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569536:0@lo:104: 10000000:01000000:3.0:1789896047.372692:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896047.372694:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372712:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789896047.372714:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569664:0@lo:104: 00010000:00010000:0.0:1789896047.372717:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372720:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372726:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789896047.372732:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569792:0@lo:104: 00010000:00010000:0.0:1789896047.372734:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a800 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896047.372737:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215087:x1876838003570560:12345-0@lo:104: Request processed in 70us (154us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896047.372741:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789896047.372743:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.372748:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789896047.372752:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569920:0@lo:104: 00010000:00010000:3.0:1789896047.372760:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372762:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372765:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789896047.372770:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003570176:0@lo:104: 00010000:00010000:2.0:1789896047.372772:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372782:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896047.372786:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372787:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003570304:0@lo:104: 00010000:00010000:2.0:1789896047.372791:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ac00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896047.372798:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372804:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003570560:0@lo:104: 00010000:00010000:3.0:1789896047.372809:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1789896047.372809:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896047.372817:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372829:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372835:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8e00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896047.372844:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1789896047.372845:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372845:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372851:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372853:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003570816:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789896047.372869:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372871:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372872:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896047.372878:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896047.372894:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896047.372895:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372897:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896047.372919:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896047.372920:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896047.372921:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:0.0:1789896047.372925:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896047.372930:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372932:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372933:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003570048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896047.372942:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.372950:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896047.372957:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896047.372958:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.372959:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896047.372982:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.372984:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896047.372989:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.372998:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896047.373003:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896047.373005:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896047.373006:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.373007:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896047.373011:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003570944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896047.373021:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570816 00000100:00100000:2.0:1789896047.373026:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570816 10000000:01000000:0.0:1789896047.373027:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896047.373044:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 24 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.373045:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896047.373046:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.373050:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896047.373055:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896047.373059:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896047.373063:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896047.373074:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.373079:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570048 00000100:00100000:2.0:1789896047.373080:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570944 00010000:00010000:0.0:1789896047.373082:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373083:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570944 00000100:00100000:3.0:1789896047.373087:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570048 00010000:00010000:2.0:1789896047.373096:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 26 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373098:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003571328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896047.373101:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896047.373106:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896047.373110:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 26 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.373111:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896047.373123:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896047.373132:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1789896047.373135:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896047.373143:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003570816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896047.373145:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571328 00000100:00100000:0.0:1789896047.373146:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003570432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896047.373152:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571328 00000100:00100000:1.0:1789896047.373155:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789896047.373156:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896047.373163:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 27 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373167:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003571456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896047.373171:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 27 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.373176:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 27 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373189:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896047.373219:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 27 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.373229:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570432 00010000:00010000:2.0:1789896047.373232:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896047.373234:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570432 00000100:00100000:1.0:1789896047.373236:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896047.373244:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003571072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896047.373255:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24da expref: 27 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.373274:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571456 00000100:00100000:2.0:1789896047.373274:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3617:x1876838003570816:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896047.373280:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571456 00000100:00100000:2.0:1789896047.373287:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1789896047.373288:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896047.373299:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 28 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373305:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571072 00000100:00100000:1.0:1789896047.373307:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003570816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896047.373310:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571072 00000100:00100000:0.0:1789896047.373322:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789896047.373327:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00010000:00010000:2.0:1789896047.373329:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 28 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373337:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003570688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896047.373342:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003570944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896047.373353:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896047.373357:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00010000:00010000:3.0:1789896047.373362:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 28 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373370:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003570048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896047.373371:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896047.373374:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896047.373385:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 28 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.373386:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896047.373391:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 28 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373395:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003571200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896047.373397:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003570688 00000100:00100000:1.0:1789896047.373405:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003570688 00010000:00010000:2.0:1789896047.373416:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 29 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.373429:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24be expref: 29 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373430:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896047.373441:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 29 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.373447:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 29 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373452:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571200 00000100:00100000:1.0:1789896047.373457:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571200 00010000:00010000:3.0:1789896047.373458:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896047.373459:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896047.373471:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 28 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373476:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789896047.373491:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003571328:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896047.373499:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00010000:00010000:0.0:1789896047.373501:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896047.373503:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003570048:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896047.373510:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003570944:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (455us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896047.373511:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 28 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373512:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3615:x1876838003570432:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896047.373518:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1789896047.373531:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00010000:00010000:1.0:1789896047.373532:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896047.373533:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 27 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373543:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00010000:00010000:1.0:1789896047.373543:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24da expref: 27 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896047.373552:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 26 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373558:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003571456:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896047.373559:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00010000:00010000:1.0:1789896047.373561:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a24da expref: 26 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.373575:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003571072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896047.373576:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896047.373579:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896047.373585:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 25 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896047.373586:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a24da expref: 25 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.373590:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896047.373600:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 25 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.373607:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 24 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373611:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003571328:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896047.373627:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00010000:00010000:1.0:1789896047.373628:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896047.373635:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 24 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.373638:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 24 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373647:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00010000:00010000:2.0:1789896047.373657:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896047.373661:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003570688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896047.373665:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 22 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373673:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003570432:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (486us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896047.373682:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896047.373685:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003571456:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (450us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896047.373689:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896047.373691:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a24be expref: 21 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373693:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789896047.373702:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00010000:00010000:0.0:1789896047.373709:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a24be expref: 20 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896047.373721:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00010000:00010000:0.0:1789896047.373725:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a24be expref: 19 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.373730:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3615:x1876838003571072:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896047.373735:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3615:x1876838003571200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896047.373744:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896047.373747:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00010000:00010000:1.0:1789896047.373749:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896047.373750:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003571456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896047.373759:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 18 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373769:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003571328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896047.373782:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 17 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.373783:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3615:x1876838003570688:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896047.373787:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003570048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896047.373801:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00010000:00010000:1.0:1789896047.373807:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 17 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.373814:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003570944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896047.373824:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896047.373841:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003570688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896047.373855:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003570432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896047.373861:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3615:x1876838003571200:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896047.373865:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003571072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896047.373874:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1789896047.373888:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003571200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896047.374270:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569024:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789896047.374271:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896047.374382:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959936 00000100:00100000:2.0:1789896047.374386:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959936 00010000:00010000:2.0:1789896047.374400:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 10 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896047.374421:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 526 00000100:00100000:2.0:1789896047.374430:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015959936:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896047.374447:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896047.374453:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 10 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.374464:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 10 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.374475:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 10 pid: 188726 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.374484:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896047.374518:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015959936:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896047.374533:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 526 00000100:00100000:1.0:1789896047.374681:0:215087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215087:1876838003569152:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896047.374722:0:215087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896047.374859:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896047.374892:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960064 00000100:00100000:3.0:1789896047.374897:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960064 00010000:00010000:3.0:1789896047.374916:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.374952:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 527 00000100:00100000:3.0:1789896047.374958:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015960064:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789896047.374977:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896047.374981:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.374988:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.374996:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 4019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375005:0:188716:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375010:0:188716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375019:0:188716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375023:0:188716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375028:0:188716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375032:0:188716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375042:0:188716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6c00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:3.0:1789896047.375045:0:188716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375050:0:188716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375062:0:188716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896047.375069:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896047.375089:0:215087:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.375093:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015960064:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 133us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896047.375102:0:215087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896047.375105:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 527 00010000:00010000:1.0:1789896047.375112:0:215087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a2504 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896047.596370:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789896048.556321:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896048.556329:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 174 10000000:01000000:1.0:1789896048.556335:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896048.556387:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.556413:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.556426:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896048.556454:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003571584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.556548:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.556594:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45121c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.556616:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571584 00000100:00100000:2.0:1789896048.556625:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571584 00000100:00100000:2.0:1789896048.556679:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:2.0:1789896048.556686:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003571584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.556705:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.556717:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a250b expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.556736:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a250b expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.556744:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a250b expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.556751:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9c00, rc 0) 00000100:00100000:2.0:1789896048.556785:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003571584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.556789:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:1.0:1789896048.556837:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003571584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896048.556852:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.556861:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896048.556940:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003571712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.556992:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.557010:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45121c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.557044:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571712 00000100:00100000:0.0:1789896048.557050:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571712 00000100:00100000:0.0:1789896048.557087:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:0.0:1789896048.557097:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003571712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.557226:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003571712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.557238:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:1.0:1789896048.557243:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003571712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.557275:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003571840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.557313:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.557331:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45121c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.557352:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571840 00000100:00100000:2.0:1789896048.557357:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571840 00000100:00100000:2.0:1789896048.557399:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:2.0:1789896048.557407:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003571840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.557500:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003571840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.557510:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:1.0:1789896048.557510:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003571840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.557806:0:215091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215091:1876838003571968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.557850:0:215091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.557865:0:215091:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f2bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.557883:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003571968 00000100:00100000:0.0:1789896048.557888:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003571968 00000100:00100000:0.0:1789896048.557915:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:0.0:1789896048.557924:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215091:x1876838003571968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.558017:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215091:x1876838003571968:12345-0@lo:502:llog_process_th.0 Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.558024:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:2.0:1789896048.558077:0:215091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215091:1876838003571968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.558115:0:215091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215091:1876838003572096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.558155:0:215091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.558174:0:215091:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f2bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.558187:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572096 00000100:00100000:0.0:1789896048.558191:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572096 00000100:00100000:0.0:1789896048.558221:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:0.0:1789896048.558225:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215091:x1876838003572096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.558291:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215091:x1876838003572096:12345-0@lo:502:llog_process_th.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.558298:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:2.0:1789896048.558305:0:215091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215091:1876838003572096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896048.558328:0:215091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:1.0:1789896048.558422:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:1.0:1789896048.558449:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896048.558455:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.558465:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896048.558473:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789896048.558475:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:1.0:1789896048.558477:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896048.558493:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.558500:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.558507:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896048.558519:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.558544:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.558566:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50cf9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.558580:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572224 00000100:00100000:0.0:1789896048.558586:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572224 00000100:00100000:0.0:1789896048.558612:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:0.0:1789896048.558618:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003572224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.558626:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896048.558635:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2519 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.558647:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.558653:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.558663:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5be00, rc 0) 00000100:00100000:0.0:1789896048.558688:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003572224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.558692:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:1.0:1789896048.558720:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896048.558731:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.558739:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896048.558772:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.558802:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.558817:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50cf9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.558838:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572352 00000100:00100000:0.0:1789896048.558844:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572352 00000100:00100000:0.0:1789896048.558862:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:0.0:1789896048.558865:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003572352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.558931:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003572352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.558938:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:1.0:1789896048.558946:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.558985:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.559016:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.559032:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50cf9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.559035:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572480 00000100:00100000:0.0:1789896048.559039:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572480 00000100:00100000:0.0:1789896048.559060:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:0.0:1789896048.559063:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003572480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.559113:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003572480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 49us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.559118:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1789896048.559135:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896048.559772:0:215092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789896048.559834:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789896048.559847:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789896048.559851:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.559857:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896048.559869:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896048.559870:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 174 10000000:01000000:0.0:1789896048.559872:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896048.559882:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.559887:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.559894:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.559907:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.559933:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.559968:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9488e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.559974:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572608 00000100:00100000:2.0:1789896048.559985:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572608 00000100:00100000:2.0:1789896048.560011:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:2.0:1789896048.560016:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003572608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.560022:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.560028:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2527 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.560038:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.560043:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.560047:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9e00, rc 0) 00000100:00100000:2.0:1789896048.560071:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003572608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.560076:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:0.0:1789896048.560093:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.560104:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.560109:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.560136:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.560153:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.560168:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9488e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.560222:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572736 00000100:00100000:3.0:1789896048.560229:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572736 00000100:00100000:3.0:1789896048.560260:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1789896048.560269:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003572736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.560349:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003572736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.560352:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.560365:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:0.0:1789896048.560387:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.560412:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.560429:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9488e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.560452:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572864 00000100:00100000:2.0:1789896048.560457:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572864 00000100:00100000:2.0:1789896048.560483:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:2.0:1789896048.560490:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003572864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.560558:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003572864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.560572:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00100000:0.0:1789896048.560575:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003572864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.560752:0:215093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215093:1876838003572992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.560786:0:215093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.560805:0:215093:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f2bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.560826:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003572992 00000100:00100000:3.0:1789896048.560830:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003572992 00000100:00100000:3.0:1789896048.560855:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:3.0:1789896048.560862:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215093:x1876838003572992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896048.560947:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215093:x1876838003572992:12345-0@lo:502:llog_process_th.0 Request processed in 84us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896048.560974:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1789896048.560977:0:215093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215093:1876838003572992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.561029:0:215093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215093:1876838003573120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.561052:0:215093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.561065:0:215093:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f2bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.561088:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573120 00000100:00100000:0.0:1789896048.561093:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573120 00000100:00100000:0.0:1789896048.561121:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:0.0:1789896048.561129:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215093:x1876838003573120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.561218:0:215093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215093:1876838003573120:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896048.561236:0:215093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000100:00100000:0.0:1789896048.561241:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215093:x1876838003573120:12345-0@lo:502:llog_process_th.0 Request processed in 110us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.561251:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000020:01000000:1.0:1789896048.561288:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:1.0:1789896048.561307:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896048.561312:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.561320:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896048.561327:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789896048.561329:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:1.0:1789896048.561331:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896048.561345:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.561351:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.561359:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896048.561381:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.561412:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.561436:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50cf9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.561461:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573248 00000100:00100000:3.0:1789896048.561466:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573248 00000100:00100000:3.0:1789896048.561493:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:3.0:1789896048.561500:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003573248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896048.561507:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896048.561515:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2535 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896048.561529:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896048.561537:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896048.561543:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2c00, rc 0) 00000100:00100000:3.0:1789896048.561576:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003573248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896048.561584:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1789896048.561595:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896048.561605:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896048.561611:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896048.561641:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.561663:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.561679:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50cf9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.561700:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573376 00000100:00100000:0.0:1789896048.561706:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573376 00000100:00100000:0.0:1789896048.561730:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:0.0:1789896048.561737:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003573376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.561805:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003573376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.561813:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00100000:1.0:1789896048.561824:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.561852:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896048.561892:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896048.561919:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50cf9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.561933:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573504 00000100:00100000:3.0:1789896048.561939:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573504 00000100:00100000:3.0:1789896048.561981:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:3.0:1789896048.561988:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003573504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.562058:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003573504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896048.562065:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00100000:1.0:1789896048.562092:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896048.562781:0:215094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789896048.562839:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789896048.562857:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789896048.562863:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.562872:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896048.562890:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896048.562892:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 174 10000000:01000000:0.0:1789896048.562894:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896048.562908:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.562915:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.562922:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.562934:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.562971:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.562995:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.562999:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573632 00000100:00100000:2.0:1789896048.563003:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573632 00000100:00100000:2.0:1789896048.563023:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230 00000100:00100000:2.0:1789896048.563028:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003573632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.563033:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.563042:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2543 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.563056:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.563065:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.563072:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9200, rc 0) 00000100:00100000:2.0:1789896048.563105:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003573632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.563110:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230 00000100:00100000:0.0:1789896048.563137:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.563148:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.563155:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.563191:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.563237:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.563265:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.563287:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573760 00000100:00100000:3.0:1789896048.563298:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573760 00000100:00100000:3.0:1789896048.563325:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:3.0:1789896048.563332:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003573760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.563400:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003573760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896048.563408:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:0.0:1789896048.563413:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.563447:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.563477:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.563494:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.563503:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003573888 00000100:00100000:2.0:1789896048.563507:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003573888 00000100:00100000:2.0:1789896048.563527:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:2.0:1789896048.563532:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003573888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.563594:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003573888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.563599:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00100000:0.0:1789896048.563608:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003573888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.563798:0:215095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215095:1876838003574016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.563842:0:215095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.563858:0:215095:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa54496540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.563882:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574016 00000100:00100000:3.0:1789896048.563887:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574016 00000100:00100000:3.0:1789896048.563919:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:3.0:1789896048.563926:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215095:x1876838003574016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896048.564011:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215095:x1876838003574016:12345-0@lo:502:llog_process_th.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896048.564018:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:2.0:1789896048.564037:0:215095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215095:1876838003574016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.564073:0:215095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215095:1876838003574144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.564102:0:215095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.564118:0:215095:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.564135:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574144 00000100:00100000:0.0:1789896048.564140:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574144 00000100:00100000:0.0:1789896048.564165:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234 00000100:00100000:0.0:1789896048.564175:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215095:x1876838003574144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.564272:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215095:x1876838003574144:12345-0@lo:502:llog_process_th.0 Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.564280:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234 00000100:00100000:2.0:1789896048.564284:0:215095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215095:1876838003574144:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896048.564305:0:215095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:0.0:1789896048.564355:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:0.0:1789896048.564375:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896048.564381:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.564389:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896048.564396:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789896048.564398:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 200 10000000:01000000:0.0:1789896048.564401:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896048.564414:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.564421:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.564438:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.564449:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.564472:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.564496:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574272 00000100:00100000:0.0:1789896048.564500:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.564502:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574272 00000100:00100000:2.0:1789896048.564530:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235 00000100:00100000:2.0:1789896048.564537:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003574272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.564543:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.564552:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2551 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.564572:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.564579:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.564586:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896048.564616:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003574272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.564622:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235 00000100:00100000:0.0:1789896048.564647:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.564657:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.564665:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.564698:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.564720:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.564736:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.564742:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574400 00000100:00100000:2.0:1789896048.564747:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574400 00000100:00100000:2.0:1789896048.564773:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:2.0:1789896048.564779:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003574400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.564845:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003574400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.564853:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1789896048.564867:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.564889:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.564919:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.564935:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.564939:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574528 00000100:00100000:2.0:1789896048.564944:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574528 00000100:00100000:2.0:1789896048.564978:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:2.0:1789896048.564983:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003574528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.565048:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003574528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.565054:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1789896048.565067:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.565261:0:215096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215096:1876838003574656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.565290:0:215096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.565309:0:215096:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.565319:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574656 00000100:00100000:0.0:1789896048.565324:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574656 00000100:00100000:0.0:1789896048.565349:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:0.0:1789896048.565355:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215096:x1876838003574656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.565441:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215096:x1876838003574656:12345-0@lo:502:llog_process_th.0 Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.565448:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:2.0:1789896048.565454:0:215096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215096:1876838003574656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896048.565479:0:215096:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896048.565487:0:215096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896048.565490:0:215096:0:(obd_config.c:1561:class_process_config()) marker 190 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:2.0:1789896048.565494:0:215096:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789896048.565508:0:215096:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:2.0:1789896048.565519:0:215096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215096:1876838003574784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.565546:0:215096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.565563:0:215096:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947bc0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.565574:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574784 00000100:00100000:0.0:1789896048.565579:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574784 00000100:00100000:0.0:1789896048.565601:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:0.0:1789896048.565607:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215096:x1876838003574784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.565670:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215096:x1876838003574784:12345-0@lo:502:llog_process_th.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.565679:0:215096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215096:1876838003574784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.565679:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000020:01000000:2.0:1789896048.565700:0:215096:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896048.565704:0:215096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896048.565705:0:215096:0:(obd_config.c:1561:class_process_config()) marker 190 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789896048.565708:0:215096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 203 count 199 00000020:01000000:0.0:1789896048.565745:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 200-202 (rc=0) 10000000:01000000:0.0:1789896048.565762:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789896048.565767:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.565775:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896048.565783:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896048.565784:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 174 10000000:01000000:0.0:1789896048.565787:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896048.565800:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.565806:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.565814:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.565830:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.565852:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.565869:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.565870:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003574912 00000100:00100000:2.0:1789896048.565875:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003574912 00000100:00100000:2.0:1789896048.565896:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:2.0:1789896048.565900:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003574912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.565904:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.565910:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a255f expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.565920:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a255f expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.565925:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a255f expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.565935:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8000, rc 0) 00000100:00100000:2.0:1789896048.565973:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003574912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.565979:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00100000:0.0:1789896048.565993:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003574912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.566004:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.566012:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.566043:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.566065:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.566079:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.566090:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575040 00000100:00100000:2.0:1789896048.566095:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575040 00000100:00100000:2.0:1789896048.566119:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:2.0:1789896048.566126:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003575040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.566185:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003575040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.566190:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00100000:0.0:1789896048.566228:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.566250:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.566281:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.566297:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575168 00000100:00100000:2.0:1789896048.566301:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575168 00000100:00100000:0.0:1789896048.566307:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.566325:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1789896048.566330:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003575168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.566389:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003575168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.566397:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:0.0:1789896048.566404:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.566613:0:215097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215097:1876838003575296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.566646:0:215097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.566663:0:215097:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa43736180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.566674:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575296 00000100:00100000:0.0:1789896048.566679:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575296 00000100:00100000:0.0:1789896048.566703:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:0.0:1789896048.566710:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215097:x1876838003575296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.566781:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215097:x1876838003575296:12345-0@lo:502:llog_process_th.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.566791:0:215097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215097:1876838003575296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.566796:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1789896048.566822:0:215097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215097:1876838003575424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.566859:0:215097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.566876:0:215097:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa41254480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.566885:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575424 00000100:00100000:0.0:1789896048.566890:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575424 00000100:00100000:0.0:1789896048.566913:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:0.0:1789896048.566919:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215097:x1876838003575424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.566992:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215097:x1876838003575424:12345-0@lo:502:llog_process_th.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.566999:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:2.0:1789896048.567002:0:215097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215097:1876838003575424:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896048.567021:0:215097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:0.0:1789896048.567059:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:0.0:1789896048.567076:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896048.567082:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.567089:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896048.567096:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789896048.567098:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 200 10000000:01000000:0.0:1789896048.567100:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896048.567112:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.567119:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.567126:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.567137:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.567164:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.567181:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.567182:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575552 00000100:00100000:2.0:1789896048.567186:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575552 00000100:00100000:2.0:1789896048.567223:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:2.0:1789896048.567227:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003575552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.567232:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.567239:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a256d expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.567248:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a256d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.567253:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a256d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.567257:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896048.567278:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003575552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.567282:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:0.0:1789896048.567301:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.567312:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.567320:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.567351:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.567375:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.567394:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575680 00000100:00100000:2.0:1789896048.567398:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575680 00000100:00100000:0.0:1789896048.567400:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.567428:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:2.0:1789896048.567435:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003575680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.567482:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003575680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.567492:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:0.0:1789896048.567507:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.567530:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.567561:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.567577:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575808 00000100:00100000:0.0:1789896048.567577:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.567581:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575808 00000100:00100000:2.0:1789896048.567604:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:2.0:1789896048.567608:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003575808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.567655:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003575808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.567659:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:0.0:1789896048.567679:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003575808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.567866:0:215098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215098:1876838003575936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896048.567898:0:215098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.567916:0:215098:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896048.567923:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003575936 00000100:00100000:0.0:1789896048.567929:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003575936 00000100:00100000:0.0:1789896048.567966:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:0.0:1789896048.567972:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215098:x1876838003575936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896048.568047:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215098:x1876838003575936:12345-0@lo:502:llog_process_th.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896048.568055:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00100000:2.0:1789896048.568058:0:215098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215098:1876838003575936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896048.568077:0:215098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896048.568082:0:215098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896048.568083:0:215098:0:(obd_config.c:1561:class_process_config()) marker 189 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:2.0:1789896048.568087:0:215098:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789896048.568093:0:215098:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:2.0:1789896048.568352:0:215098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215098:1876838003576064:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789896048.568366:0:215099:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789896048.568376:0:215099:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:2.0:1789896048.568378:0:215098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.568402:0:215098:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa43736180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.568422:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003576064 00000100:00100000:3.0:1789896048.568429:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003576064 00000100:00100000:3.0:1789896048.568465:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:3.0:1789896048.568477:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215098:x1876838003576064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896048.568574:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215098:x1876838003576064:12345-0@lo:502:llog_process_th.0 Request processed in 102us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.568582:0:215098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215098:1876838003576064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896048.568583:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000020:01000000:2.0:1789896048.568601:0:215098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896048.568605:0:215098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896048.568606:0:215098:0:(obd_config.c:1561:class_process_config()) marker 189 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789896048.568608:0:215098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 203 count 199 00000020:01000000:0.0:1789896048.568652:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 200-202 (rc=0) 10000000:01000000:0.0:1789896048.568670:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789896048.568675:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.568684:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896048.568691:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789896048.568693:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:0.0:1789896048.568695:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789896048.568707:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.568714:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.568721:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.568732:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003576192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.568755:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896048.568773:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003576192 00000100:00100000:0.0:1789896048.568774:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896048.568777:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003576192 00000100:00100000:2.0:1789896048.568799:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:2.0:1789896048.568803:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003576192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.568808:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.568813:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a257b expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.568827:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a257b expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.568837:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a257b expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.568844:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 00000100:00100000:2.0:1789896048.568875:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003576192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.568882:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:0.0:1789896048.568889:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003576192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896048.568902:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.568910:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896048.568967:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003576320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896048.568990:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896048.569005:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896048.569030:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003576320 00000100:00100000:3.0:1789896048.569036:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003576320 00000100:00100000:3.0:1789896048.569062:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:3.0:1789896048.569070:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003576320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.569122:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003576320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896048.569133:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003576320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.569145:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 10000000:01000000:0.0:1789896048.569163:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789896048.569169:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896048.569177:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896048.620366:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896048.883664:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896048.883720:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960192 00000100:00100000:2.0:1789896048.883731:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960192 00000100:00100000:2.0:1789896048.883778:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2252 00000100:00100000:2.0:1789896048.883786:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015960192:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.883799:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.883814:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f62b expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.883837:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.883860:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.883867:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896048.883913:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015960192:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 128us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.883918:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2252 00000100:00100000:2.0:1789896048.884890:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896048.884944:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960320 00000100:00100000:3.0:1789896048.884960:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960320 00000100:00100000:3.0:1789896048.885000:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2253 00000100:00100000:3.0:1789896048.885008:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015960320:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896048.885135:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015960320:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 128us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896048.885142:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2253 00000100:00100000:0.0:1789896048.885870:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896048.885930:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960448 00000100:00100000:2.0:1789896048.885936:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960448 00000100:00100000:2.0:1789896048.885979:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2254 00000100:00100000:2.0:1789896048.885988:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015960448:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.886073:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015960448:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.886081:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2254 00000100:00100000:0.0:1789896048.887077:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896048.887121:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960576 00000100:00100000:2.0:1789896048.887125:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960576 00000100:00100000:2.0:1789896048.887153:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2255 00000100:00100000:2.0:1789896048.887161:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214474:x1876838015960576:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896048.887271:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214474:x1876838015960576:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 110us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.887279:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2255 00000100:00100000:3.0:1789896048.887985:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896048.888029:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960704 00000100:00100000:2.0:1789896048.888034:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960704 00000100:00100000:2.0:1789896048.888064:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2256 00000100:00100000:2.0:1789896048.888080:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:214474:x1876838015960704:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896048.888144:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:214474:x1876838015960704:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.888153:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2256 00000100:00100000:0.0:1789896048.888978:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896048.889024:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960832 00000100:00100000:2.0:1789896048.889029:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960832 00000100:00100000:2.0:1789896048.889057:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2257 00000100:00100000:2.0:1789896048.889064:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015960832:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896048.889074:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896048.889090:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f632 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.889110:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.889119:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896048.889125:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8e00, rc 0) 00000100:00100000:2.0:1789896048.889147:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015960832:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896048.889153:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2257 00000100:00100000:0.0:1789896048.889800:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896048.889844:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015960960 00000100:00100000:2.0:1789896048.889847:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015960960 00000100:00100000:2.0:1789896048.889869:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2258 00000100:00100000:2.0:1789896048.889883:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015960960:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896048.889965:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015960960:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 89us (165us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896048.889970:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2258 00000100:00100000:3.0:1789896049.523743:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896049.523786:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896049.523792:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961216 00000100:00100000:2.0:1789896049.523803:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961216 00000100:00100000:3.0:1789896049.523827:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896049.523846:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961088 00000100:00100000:0.0:1789896049.523853:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961088 00000100:00080000:3.0:1789896049.523873:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896049.523877:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961344 00000100:00100000:2.0:1789896049.523883:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961344 00000100:00100000:0.0:1789896049.523901:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2259 00000100:00100000:3.0:1789896049.523904:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 521 00000100:00100000:0.0:1789896049.523916:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015961088:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789896049.523920:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015961216:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896049.523931:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 522 00000100:00100000:2.0:1789896049.523952:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015961344:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896049.524000:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015961088:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896049.524002:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015961216:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896049.524003:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015961344:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896049.524020:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 521 00000100:00100000:0.0:1789896049.524023:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2259 00000100:00100000:2.0:1789896049.524029:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 522 00000100:00080000:3.0:1789896049.524062:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789896049.644404:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789896049.661408:0:215147:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffffefcfc50 20000000:00000080:0.0:1789896049.661424:0:215147:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a953c01400 uarg=0000000000000000 00000040:00100000:0.0:1789896049.661886:0:215147:0:(llog.c:1072:llog_reverse_process()) index 176 : idx 137 20000000:01000000:0.0:1789896049.661892:0:215147:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 166 cmd:0xce021 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:0.0:1789896049.661902:0:215147:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789896049.662193:0:215148:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 179 1->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789896049.662255:0:215148:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 167 marker 179 2->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789896049.662271:0:215148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000040:00080000:0.0:1789896049.662389:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].177, 224 off40584 20000000:01000000:0.0:1789896049.662401:0:215147:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789896049.662409:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].178, 128 off40712 00000040:00080000:0.0:1789896049.662418:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].179, 224 off40936 20000000:01000000:0.0:1789896049.662426:0:215147:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789896049.662683:0:215149:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 191 marker 180 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789896049.662703:0:215149:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 193 marker 180 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789896049.662716:0:215149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 203 count 199 00000040:00080000:0.0:1789896049.662801:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].203, 224 off45400 20000000:01000000:0.0:1789896049.662811:0:215147:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789896049.662825:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].204, 136 off45536 00000040:00080000:0.0:1789896049.662841:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].205, 224 off45760 20000000:01000000:0.0:1789896049.662854:0:215147:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789896049.663102:0:215150:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 191 marker 181 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789896049.663117:0:215150:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 193 marker 181 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789896049.663125:0:215150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 203 count 199 00000040:00080000:0.0:1789896049.663194:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].203, 224 off45400 20000000:01000000:0.0:1789896049.663225:0:215147:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789896049.663243:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].204, 136 off45536 00000040:00080000:0.0:1789896049.663258:0:215147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].205, 224 off45760 10000000:01000000:0.0:1789896049.663268:0:215147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789896049.663285:0:215147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663303:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a250b expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663311:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663318:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663336:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663343:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663348:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663355:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a255f expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663361:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a256d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663367:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a257b expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663376:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663383:0:215147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663392:0:215147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663430:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663455:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 9 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.663470:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576448:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896049.663567:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663577:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 9 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.663586:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576576:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896049.663621:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a257b expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663631:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a257b expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.663641:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576704:0@lo:104: 00000100:00100000:0.0:1789896049.663675:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896049.663705:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003576704 00010000:00010000:0.0:1789896049.663710:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a256d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.663712:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003576704 00010000:00010000:0.0:1789896049.663723:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a256d expref: 23 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.663733:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576832:0@lo:104: 00000100:00100000:2.0:1789896049.663754:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1789896049.663765:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a946819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003576704:12345-0@lo:104: 00000100:00100000:0.0:1789896049.663766:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896049.663775:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.663797:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003576832 00000100:00100000:1.0:1789896049.663803:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003576832 00010000:00010000:0.0:1789896049.663812:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a255f expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.663823:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a255f expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.663834:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576960:0@lo:104: 00010000:00010000:2.0:1789896049.663839:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896049.663840:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789896049.663850:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a946819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003576704:12345-0@lo:104: Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896049.663859:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789896049.663862:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a946819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003576832:12345-0@lo:104: 00000100:00100000:0.0:1789896049.663871:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896049.663873:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.663877:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896049.663890:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.663900:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a400 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896049.663901:0:200085:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789896049.663904:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896049.663907:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.663916:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003576960 00010000:00010000:0.0:1789896049.663917:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 23 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.663922:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003576960 00010000:00010000:1.0:1789896049.663926:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896049.663933:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a469180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577088:0@lo:104: 00000100:00100000:1.0:1789896049.663934:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a946819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003576832:12345-0@lo:104: Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896049.663958:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789896049.663965:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789896049.663974:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003576960:12345-0@lo:104: 00010000:00010000:2.0:1789896049.663980:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.663983:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896049.663984:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896049.663993:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.664007:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b000 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896049.664008:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896049.664012:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.664018:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896049.664023:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.664028:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789896049.664036:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664038:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003576960:12345-0@lo:104: Request processed in 66us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896049.664045:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664057:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 10000000:00010000:1.0:1789896049.664060:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896049.664070:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896049.664073:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a469f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577216:0@lo:104: 10000000:01000000:3.0:1789896049.664096:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896049.664103:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664104:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577088 00000100:00100000:0.0:1789896049.664104:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896049.664110:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577088 00010000:00010000:1.0:1789896049.664116:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896049.664119:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664128:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896049.664131:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577216 00000100:00100000:2.0:1789896049.664135:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577216 00010000:00010000:0.0:1789896049.664141:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664144:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.664149:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664152:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00010000:00010000:0.0:1789896049.664161:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 23 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664166:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003577088:12345-0@lo:104: 00010000:00010000:3.0:1789896049.664168:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a257b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2582 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.664175:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a256d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2574 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.664183:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664190:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577600:0@lo:104: 00010000:00010000:3.0:1789896049.664194:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896049.664242:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896049.664245:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896049.664249:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896049.664268:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789896049.664276:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003577088:12345-0@lo:104: Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896049.664277:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003577344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896049.664292:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1789896049.664311:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896049.664315:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00010000:00010000:3.0:1789896049.664324:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664325:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896049.664327:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003577216:12345-0@lo:104: 00010000:00010000:3.0:1789896049.664339:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b800 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896049.664342:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896049.664344:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.664347:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664355:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789896049.664367:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003577472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896049.664368:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.664372:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896049.664388:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664393:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577728:0@lo:104: 00010000:00010000:2.0:1789896049.664399:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:3.0:1789896049.664409:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896049.664409:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896049.664411:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003577216:12345-0@lo:104: Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896049.664421:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789896049.664428:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896049.664436:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664437:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577600 00000100:00100000:2.0:1789896049.664443:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577600 00010000:00010000:3.0:1789896049.664446:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896049.664457:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664467:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664467:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577728 00010000:00010000:0.0:1789896049.664469:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 23 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664470:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577344 00000100:00100000:2.0:1789896049.664472:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577728 00000100:00100000:1.0:1789896049.664477:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577344 00000100:00100000:0.0:1789896049.664487:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577984:0@lo:104: 00000100:00100000:2.0:1789896049.664491:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00010000:00010000:1.0:1789896049.664501:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a256d expref: 24 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664502:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003577600:12345-0@lo:104: 00010000:00010000:2.0:1789896049.664515:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664516:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896049.664536:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577472 00000100:00100000:1.0:1789896049.664540:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577472 00010000:00010000:0.0:1789896049.664542:0:215147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a250b expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664545:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a255f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2566 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.664558:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a257b expref: 25 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.664558:0:215147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a250b expref: 25 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.664561:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789896049.664562:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896049.664570:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664574:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003577600:12345-0@lo:104: Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896049.664577:0:215147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003578112:0@lo:104: 00010000:00010000:3.0:1789896049.664591:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a600 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896049.664593:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 10000000:00010000:3.0:1789896049.664596:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664604:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664606:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1789896049.664608:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577984 00000100:00100000:2.0:1789896049.664613:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577984 00000100:00100000:0.0:1789896049.664616:0:215147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896049.664622:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003577344:12345-0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789896049.664624:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664629:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578112 00000100:00100000:2.0:1789896049.664633:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578112 10000000:01000000:3.0:1789896049.664634:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896049.664636:0:215147:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9531799c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789896049.664643:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896049.664649:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00010000:00010000:1.0:1789896049.664652:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a256d expref: 25 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664656:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664661:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576704:0@lo:104: 00000100:00100000:2.0:1789896049.664666:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215147:x1876838003577728:12345-0@lo:104: 00010000:00010000:3.0:1789896049.664677:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896049.664677:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a256d expref: 25 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.664680:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664682:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576832:0@lo:104: 00010000:00010000:3.0:1789896049.664696:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664699:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576960:0@lo:104: 00010000:00010000:1.0:1789896049.664707:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a256d expref: 25 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664721:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a469180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577088:0@lo:104: 00010000:00010000:2.0:1789896049.664723:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789896049.664728:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896049.664729:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215147:x1876838003577728:12345-0@lo:104: Request processed in 66us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896049.664735:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a469f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577216:0@lo:104: 00000100:00100000:2.0:1789896049.664738:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00010000:00010000:3.0:1789896049.664752:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2558 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664756:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577600:0@lo:104: 00000100:00100000:2.0:1789896049.664759:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789896049.664770:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3615:x1876838003577344:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896049.664773:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003577984:12345-0@lo:104: 00010000:00010000:3.0:1789896049.664774:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789896049.664776:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577728:0@lo:104: 00010000:00010000:3.0:1789896049.664782:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.664785:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664790:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:3.0:1789896049.664798:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896049.664803:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664810:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664814:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 10000000:00010000:3.0:1789896049.664822:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664828:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003577472:12345-0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789896049.664831:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896049.664832:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789896049.664841:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896049.664843:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215147:x1876838003577984:12345-0@lo:104: Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896049.664846:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003577984:0@lo:104: 00010000:00010000:1.0:1789896049.664848:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a257b expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664853:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664861:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00010000:00010000:3.0:1789896049.664871:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896049.664873:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a257b expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664883:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00010000:00010000:1.0:1789896049.664889:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a257b expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.664890:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.664895:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003578112:12345-0@lo:104: 00000100:00100000:0.0:1789896049.664896:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789896049.664910:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a2543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a254a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664912:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003578368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896049.664913:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.664913:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896049.664954:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003577472:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (536us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896049.664958:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789896049.664963:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00010000:00010000:3.0:1789896049.664964:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.664971:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896049.664978:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6a00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896049.664981:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:3.0:1789896049.664983:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.664983:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578368 00000100:00100000:1.0:1789896049.664989:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578368 00000100:00100000:2.0:1789896049.664991:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215147:x1876838003578112:12345-0@lo:104: Request processed in 99us (379us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896049.665002:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665006:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665007:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1789896049.665014:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003578112:0@lo:104: 10000000:00010000:3.0:1789896049.665024:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896049.665031:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896049.665032:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896049.665043:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665049:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.665051:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00010000:00010000:2.0:1789896049.665053:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896049.665061:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789896049.665061:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.665067:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3616:x1876838003578368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896049.665079:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665080:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665084:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003578496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896049.665096:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1789896049.665100:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665103:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6a00/0x412fd4b3617a2535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a253c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665105:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665117:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789896049.665123:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896049.665134:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665135:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896049.665143:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665147:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665151:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578496 00010000:00010000:1.0:1789896049.665152:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a254a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2543 expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665158:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578496 00010000:00010000:2.0:1789896049.665162:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896049.665171:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665176:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6000 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896049.665176:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 22 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665179:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a252e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665179:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1789896049.665183:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665219:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896049.665224:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665225:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665225:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789896049.665238:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3616:x1876838003578368:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (267us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896049.665241:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6c00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:0.0:1789896049.665241:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3616:x1876838003578496:12345-0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789896049.665246:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896049.665248:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.665257:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896049.665258:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 10000000:01000000:3.0:1789896049.665267:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896049.665267:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 22 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665282:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.665287:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 21 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896049.665290:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665291:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896049.665307:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896049.665310:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896049.665311:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a253c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2535 expref: 21 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.665313:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003578240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896049.665320:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665327:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665341:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2520 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665342:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896049.665343:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896049.665351:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896049.665355:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665361:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896049.665364:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a250b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2512 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896049.665365:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896049.665369:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896049.665387:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896049.665388:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3616:x1876838003578496:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (272us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896049.665390:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896049.665393:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896049.665397:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003578752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896049.665401:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00010000:00010000:2.0:1789896049.665402:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896049.665409:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896049.665420:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003577856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896049.665423:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578240 00000100:00100000:0.0:1789896049.665428:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578240 00000100:00100000:1.0:1789896049.665434:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896049.665446:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 20 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665460:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896049.665463:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578752 00000100:00100000:0.0:1789896049.665468:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578752 00000100:00100000:1.0:1789896049.665478:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003577856 00010000:00010000:0.0:1789896049.665482:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 21 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665484:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003578624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896049.665484:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003577856 00000100:00100000:0.0:1789896049.665504:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00010000:00010000:1.0:1789896049.665505:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a255f expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665514:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003578240:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896049.665520:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896049.665525:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896049.665529:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578624 00010000:00010000:0.0:1789896049.665530:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 22 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.665534:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578624 00010000:00010000:0.0:1789896049.665541:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 23 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665550:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 23 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.665556:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2551 expref: 23 pid: 188725 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.665566:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00010000:00010000:0.0:1789896049.665571:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896049.665575:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1789896049.665578:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003578752:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896049.665588:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:3.0:1789896049.665594:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896049.665595:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3617:x1876838003577856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896049.665603:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 22 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665608:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896049.665613:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003578240:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (265us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896049.665618:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a255f expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665629:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:3.0:1789896049.665633:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 22 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665643:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:1.0:1789896049.665653:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a255f expref: 22 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665658:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961472 00000100:00100000:0.0:1789896049.665662:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961472 00010000:00010000:3.0:1789896049.665668:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2519 expref: 21 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665674:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a255f expref: 21 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.665675:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 10 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665686:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003578496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896049.665687:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896049.665703:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003578368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896049.665704:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896049.665705:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961600 00000100:00100000:0.0:1789896049.665710:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961600 00010000:00010000:0.0:1789896049.665722:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 11 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665725:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789896049.665730:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3618:x1876838003578752:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896049.665735:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003578880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896049.665740:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1789896049.665748:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1789896049.665753:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3617:x1876838003578624:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896049.665754:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3617:x1876838003577856:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (291us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896049.665763:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896049.665766:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896049.665769:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00010000:00010000:0.0:1789896049.665770:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 18 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.665779:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 536 00010000:00010000:0.0:1789896049.665780:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 18 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.665793:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003578880 00010000:00010000:0.0:1789896049.665794:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a252e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2527 expref: 17 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.665795:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015961472:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896049.665799:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003577472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896049.665799:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003578880 00010000:00010000:3.0:1789896049.665814:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896049.665814:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896049.665817:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a250b expref: 17 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665820:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003577344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896049.665823:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 11 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665842:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3617:x1876838003578624:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (324us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896049.665846:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 11 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896049.665850:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 537 00010000:00010000:2.0:1789896049.665851:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896049.665859:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1789896049.665864:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015961600:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789896049.665865:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896049.665875:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896049.665879:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00010000:00010000:1.0:1789896049.665884:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 11 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.665893:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3616:x1876838003578880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896049.665898:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 11 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.665903:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015961472:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 111us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896049.665907:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896049.665915:0:215147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f632 expref: 11 pid: 188723 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896049.665916:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a250b expref: 16 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.665919:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 536 00010000:00010000:2.0:1789896049.665950:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a250b expref: 16 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.665974:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576448:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789896049.665978:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003577856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896049.665980:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a2512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a250b expref: 16 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.665980:0:191756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.665991:0:215147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f62b expref: 9 pid: 188726 timeout: 4021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.665997:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003578624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896049.666006:0:191756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896049.666014:0:215147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215147:1876838003576576:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896049.666015:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896049.666023:0:191756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.666033:0:191756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.666041:0:191756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.666048:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003578880:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (285us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896049.666048:0:191756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.666061:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00010000:00010000:1.0:1789896049.666061:0:191756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ae00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:0.0:1789896049.666063:0:215147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.666070:0:191756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.666073:0:215147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.666087:0:191756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896049.666087:0:215147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896049.666090:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003578880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896049.666110:0:191756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896049.666117:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003578752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896049.666119:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a2597 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896049.666147:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896049.666180:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003578240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896049.666181:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015961600:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 318us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896049.666193:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 537 00000100:00100000:3.0:1789896050.092380:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003579136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896050.092388:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003579392:0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.092445:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003579520:0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.092463:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896050.092463:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896050.092497:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896050.092512:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003579904:0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.092513:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003579008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789896050.092519:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579136 00000100:00100000:2.0:1789896050.092520:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003580032:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.092528:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579136 00000100:00100000:1.0:1789896050.092551:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896050.092557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896050.092557:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896050.092585:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003580544:0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.092592:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003579776:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.092595:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003580416:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.092597:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579008 00000100:00100000:0.0:1789896050.092603:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579008 00000100:00100000:3.0:1789896050.092618:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896050.092618:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896050.092644:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789896050.092651:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003580288:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.092652:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579904 00000100:00100000:0.0:1789896050.092658:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003579136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896050.092659:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579904 00000100:00100000:2.0:1789896050.092663:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789896050.092671:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003579264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896050.092680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789896050.092688:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896050.092696:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896050.092703:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876838003580800:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.092705:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580544 00000100:00100000:2.0:1789896050.092710:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003579648:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.092711:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580544 00000100:00100000:3.0:1789896050.092737:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896050.092745:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896050.092749:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580800 00000100:00100000:0.0:1789896050.092750:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003579136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896050.092755:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580800 00000100:00100000:2.0:1789896050.092763:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003580160:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.092764:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789896050.092782:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003579136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896050.092791:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896050.092793:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579264 00000100:00100000:1.0:1789896050.092797:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1789896050.092800:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579264 00000100:00100000:1.0:1789896050.092809:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003579904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.092813:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003580672:0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.092817:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579520 00000100:00100000:3.0:1789896050.092821:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579520 00000100:00100000:0.0:1789896050.092829:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789896050.092842:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896050.092848:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003579008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896050.092853:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580032 00000100:00100000:3.0:1789896050.092857:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580032 00002000:00000024:0.0:1789896050.092860:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896050.092868:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003579904:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896050.092875:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789896050.092880:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789896050.092884:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789896050.092886:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003579520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.092892:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003580032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.092904:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580672 00000100:00100000:0.0:1789896050.092906:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003579008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896050.092909:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580672 00000100:00100000:0.0:1789896050.092917:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789896050.092935:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003580032:12345-0@lo:400:kworker.0 Request processed in 42us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896050.092935:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003579520:12345-0@lo:400:kworker.0 Request processed in 49us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.092951:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789896050.092956:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1789896050.092965:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003579264:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896050.092966:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789896050.092970:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.092976:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00002000:00000024:0.0:1789896050.092988:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789896050.092993:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789896050.093000:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789896050.093000:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00080000:3.0:1789896050.093003:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789896050.093007:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789896050.093009:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3617:x1876838003580800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.093022:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003580544:12345-0@lo:400:kworker.0 Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.093029:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003579264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896050.093034:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789896050.093046:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003580672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.093046:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3617:x1876838003580800:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.093050:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789896050.093053:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1789896050.093062:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1789896050.093084:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579392 00000100:00100000:3.0:1789896050.093086:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003580672:12345-0@lo:400:kworker.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.093091:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579392 00000100:00100000:3.0:1789896050.093096:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1789896050.093097:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579776 00000100:00100000:2.0:1789896050.093101:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579776 00000100:00100000:1.0:1789896050.093105:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580288 00000100:00100000:1.0:1789896050.093111:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580288 00000100:00100000:3.0:1789896050.093124:0:191520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003579648 00000100:00100000:3.0:1789896050.093130:0:191520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003579648 00000100:00100000:0.0:1789896050.093131:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:2.0:1789896050.093137:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580160 00000100:00100000:2.0:1789896050.093142:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580160 00000100:00100000:1.0:1789896050.093142:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789896050.093144:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003579392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.093157:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003579776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.093168:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789896050.093181:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789896050.093183:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003580288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.093189:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a946819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003579648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.093219:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003579392:12345-0@lo:400:kworker.0 Request processed in 53us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896050.093227:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003579776:12345-0@lo:400:kworker.0 Request processed in 75us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.093230:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:1.0:1789896050.093241:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789896050.093246:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003580288:12345-0@lo:400:kworker.0 Request processed in 69us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896050.093253:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a946819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003579648:12345-0@lo:400:kworker.0 Request processed in 66us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896050.093255:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789896050.093260:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789896050.093267:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789896050.093276:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a946819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003580160:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789896050.093286:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896050.093301:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003579776:0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.093301:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896050.093318:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003580288:0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.093326:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003580928:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.093328:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a946819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003580160:12345-0@lo:400:kworker.0 Request processed in 51us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896050.093332:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876838003580800:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.093335:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580416 00000100:00100000:0.0:1789896050.093343:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580416 00000100:00100000:1.0:1789896050.093347:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789896050.093353:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003579008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896050.093356:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896050.093380:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003579392:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.093382:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003580928 00000100:00100000:0.0:1789896050.093387:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003580928 00000100:00100000:1.0:1789896050.093389:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1789896050.093393:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003579904:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.093403:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003580416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.093419:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003579264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789896050.093422:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789896050.093432:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1789896050.093435:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003579648:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.093445:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003580928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.093452:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003580160:0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.093457:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003580416:0@lo:400:kworker.0 00000100:00100000:1.0:1789896050.093462:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003580416:12345-0@lo:400:kworker.0 Request processed in 60us (157us total) trans 0 rc 0/0 00010000:00080000:3.0:1789896050.093468:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a946818a80 x1876838003580672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896050.093476:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1789896050.093488:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003580672:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.093498:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003580928:12345-0@lo:400:kworker.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896050.093505:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003579520:0@lo:400:kworker.0 00000100:00100000:0.0:1789896050.093508:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00080000:2.0:1789896050.093516:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a946819f80 x1876838003580928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896050.093525:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003580032:0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.093526:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003580928:0@lo:400:kworker.0 00000100:00100000:3.0:1789896050.093537:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003580544:0@lo:400:kworker.0 00000100:00100000:2.0:1789896050.355601:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.355665:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961728 00000100:00100000:0.0:1789896050.355674:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961728 00000100:00100000:0.0:1789896050.355726:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2261 00000100:00100000:0.0:1789896050.355736:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015961728:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896050.355752:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896050.355772:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f639 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896050.355796:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896050.355804:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896050.355811:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b600, rc 0) 00000100:00100000:0.0:1789896050.355856:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015961728:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 124us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.355861:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2261 00000100:00100000:2.0:1789896050.356649:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.356689:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961856 00000100:00100000:0.0:1789896050.356693:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961856 00000100:00100000:0.0:1789896050.356716:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2262 00000100:00100000:0.0:1789896050.356723:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015961856:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896050.356839:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015961856:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 115us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.356847:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2262 00000100:00100000:3.0:1789896050.357466:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.357522:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015961984 00000100:00100000:0.0:1789896050.357526:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015961984 00000100:00100000:0.0:1789896050.357575:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2263 00000100:00100000:0.0:1789896050.357581:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015961984:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896050.357647:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015961984:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.357651:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2263 00000100:00100000:2.0:1789896050.358622:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.358669:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962112 00000100:00100000:0.0:1789896050.358674:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962112 00000100:00100000:0.0:1789896050.358703:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2264 00000100:00100000:0.0:1789896050.358710:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214484:x1876838015962112:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896050.358782:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214484:x1876838015962112:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.358787:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2264 00000100:00100000:2.0:1789896050.359476:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.359519:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962240 00000100:00100000:0.0:1789896050.359524:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962240 00000100:00100000:0.0:1789896050.359563:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2265 00000100:00100000:0.0:1789896050.359570:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:214484:x1876838015962240:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896050.359636:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:214484:x1876838015962240:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.359642:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2265 00000100:00100000:3.0:1789896050.360516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.360569:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962368 00000100:00100000:0.0:1789896050.360573:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962368 00000100:00100000:0.0:1789896050.360609:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2266 00000100:00100000:0.0:1789896050.360618:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015962368:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896050.360628:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896050.360645:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f640 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896050.360677:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896050.360689:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896050.360698:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5be00, rc 0) 00000100:00100000:0.0:1789896050.360729:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015962368:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896050.360736:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2266 00000100:00100000:2.0:1789896050.361403:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896050.361453:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962496 00000100:00100000:0.0:1789896050.361463:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962496 00000100:00100000:0.0:1789896050.361493:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2267 00000100:00100000:0.0:1789896050.361502:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015962496:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896050.361567:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015962496:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 67us (165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896050.361575:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2267 00010000:00010000:3.0:1789896050.669312:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789896051.052250:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896051.052272:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 177 10000000:01000000:2.0:1789896051.052277:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896051.052324:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.052333:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.052342:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.052361:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.052415:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.052458:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.052479:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581056 00000100:00100000:0.0:1789896051.052487:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581056 00000100:00100000:0.0:1789896051.052534:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:0.0:1789896051.052544:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003581056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.052557:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.052570:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a25ac expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.052590:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.052603:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.052616:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ae00, rc 0) 00000100:00100000:0.0:1789896051.052654:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003581056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.052660:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00100000:2.0:1789896051.052688:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896051.052702:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.052711:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.052757:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.052773:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.052789:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.052811:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581184 00000100:00100000:0.0:1789896051.052815:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581184 00000100:00100000:0.0:1789896051.052842:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:0.0:1789896051.052849:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003581184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.052964:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003581184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.052971:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:2.0:1789896051.052988:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.053013:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.053045:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.053064:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.053081:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581312 00000100:00100000:0.0:1789896051.053085:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581312 00000100:00100000:0.0:1789896051.053105:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:0.0:1789896051.053110:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003581312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.053183:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003581312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.053189:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:2.0:1789896051.053196:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.053488:0:215151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215151:1876838003581440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.053511:0:215151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.053530:0:215151:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.053546:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581440 00000100:00100000:0.0:1789896051.053549:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581440 00000100:00100000:0.0:1789896051.053570:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1789896051.053576:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215151:x1876838003581440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.053649:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215151:x1876838003581440:12345-0@lo:502:llog_process_th.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.053655:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:2.0:1789896051.053662:0:215151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215151:1876838003581440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.053696:0:215151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215151:1876838003581568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.053722:0:215151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.053736:0:215151:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.053755:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581568 00000100:00100000:0.0:1789896051.053758:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581568 00000100:00100000:0.0:1789896051.053778:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:0.0:1789896051.053784:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215151:x1876838003581568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.053840:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215151:x1876838003581568:12345-0@lo:502:llog_process_th.0 Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.053846:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:2.0:1789896051.053852:0:215151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215151:1876838003581568:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896051.053868:0:215151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:1.0:1789896051.053949:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:1.0:1789896051.053982:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896051.053988:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.053995:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896051.054007:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789896051.054009:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:1.0:1789896051.054010:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896051.054022:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.054026:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.054031:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.054040:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.054062:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.054078:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.054101:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581696 00000100:00100000:0.0:1789896051.054106:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581696 00000100:00100000:0.0:1789896051.054126:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1789896051.054131:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003581696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.054136:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.054142:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a25ba expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.054152:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.054157:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.054162:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a800, rc 0) 00000100:00100000:0.0:1789896051.054187:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003581696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.054221:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:1.0:1789896051.054237:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896051.054250:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.054258:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.054300:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.054323:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.054349:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.054358:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581824 00000100:00100000:0.0:1789896051.054362:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581824 00000100:00100000:0.0:1789896051.054382:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:0.0:1789896051.054386:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003581824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.054441:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003581824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.054445:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1789896051.054480:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.054512:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.054540:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.054552:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.054563:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003581952 00000100:00100000:0.0:1789896051.054566:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003581952 00000100:00100000:0.0:1789896051.054586:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1789896051.054592:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003581952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.054663:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003581952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.054669:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1789896051.054688:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003581952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789896051.055172:0:215152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789896051.055214:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789896051.055231:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789896051.055236:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.055242:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896051.055247:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896051.055248:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 177 10000000:01000000:1.0:1789896051.055249:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896051.055260:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.055264:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.055269:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.055277:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.055296:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.055312:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.055339:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582080 00000100:00100000:0.0:1789896051.055344:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582080 00000100:00100000:0.0:1789896051.055372:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1789896051.055379:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003582080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.055386:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.055394:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a25c8 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.055408:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.055416:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.055429:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a600, rc 0) 00000100:00100000:0.0:1789896051.055461:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003582080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.055467:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:1.0:1789896051.055480:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896051.055495:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.055500:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.055525:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.055542:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.055562:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.055583:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582208 00000100:00100000:0.0:1789896051.055588:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582208 00000100:00100000:0.0:1789896051.055610:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:0.0:1789896051.055617:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003582208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.055669:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003582208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.055674:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1789896051.055689:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.055708:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.055730:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.055741:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.055758:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582336 00000100:00100000:0.0:1789896051.055763:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582336 00000100:00100000:0.0:1789896051.055789:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:0.0:1789896051.055796:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003582336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.055863:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003582336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.055870:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:1.0:1789896051.055889:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.056064:0:215153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215153:1876838003582464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.056089:0:215153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.056101:0:215153:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.056118:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582464 00000100:00100000:0.0:1789896051.056123:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582464 00000100:00100000:0.0:1789896051.056146:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1789896051.056154:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215153:x1876838003582464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.056252:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215153:x1876838003582464:12345-0@lo:502:llog_process_th.0 Request processed in 99us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.056257:0:215153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215153:1876838003582464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.056263:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:2.0:1789896051.056288:0:215153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215153:1876838003582592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.056313:0:215153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.056334:0:215153:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.056336:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582592 00000100:00100000:0.0:1789896051.056340:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582592 00000100:00100000:0.0:1789896051.056362:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:0.0:1789896051.056366:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215153:x1876838003582592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.056417:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215153:x1876838003582592:12345-0@lo:502:llog_process_th.0 Request processed in 50us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.056423:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:2.0:1789896051.056425:0:215153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215153:1876838003582592:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896051.056444:0:215153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:1.0:1789896051.056480:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:1.0:1789896051.056497:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896051.056501:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.056506:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896051.056511:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789896051.056512:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:1.0:1789896051.056514:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896051.056523:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.056535:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.056539:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.056547:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.056571:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.056588:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.056605:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582720 00000100:00100000:0.0:1789896051.056609:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582720 00000100:00100000:0.0:1789896051.056630:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1789896051.056638:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003582720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.056645:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.056653:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a25d6 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.056667:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.056676:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.056683:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b800, rc 0) 00000100:00100000:0.0:1789896051.056716:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003582720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.056723:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:1.0:1789896051.056730:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896051.056739:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.056745:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.056768:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.056785:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.056795:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.056811:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582848 00000100:00100000:0.0:1789896051.056816:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582848 00000100:00100000:0.0:1789896051.056838:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:0.0:1789896051.056844:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003582848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.056911:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003582848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.056920:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1789896051.056937:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.056958:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.056981:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.056992:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.057008:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003582976 00000100:00100000:0.0:1789896051.057012:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003582976 00000100:00100000:0.0:1789896051.057035:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:0.0:1789896051.057043:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003582976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.057110:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003582976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.057117:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1789896051.057121:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003582976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896051.057597:0:215154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789896051.057649:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789896051.057664:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789896051.057672:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.057678:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896051.057683:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896051.057684:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 177 10000000:01000000:2.0:1789896051.057685:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896051.057695:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.057699:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.057704:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.057711:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.057727:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.057742:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.057766:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583104 00000100:00100000:0.0:1789896051.057772:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583104 00000100:00100000:0.0:1789896051.057797:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:0.0:1789896051.057804:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003583104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.057810:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.057818:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a25e4 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.057831:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.057839:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.057845:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a400, rc 0) 00000100:00100000:0.0:1789896051.057877:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003583104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.057886:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.057899:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00010000:00010000:2.0:1789896051.057902:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.057911:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.057959:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.057990:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.058005:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.058017:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583232 00000100:00100000:0.0:1789896051.058023:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583232 00000100:00100000:0.0:1789896051.058045:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:0.0:1789896051.058051:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003583232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.058113:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003583232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.058122:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.058123:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1789896051.058149:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.058172:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.058183:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.058215:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583360 00000100:00100000:0.0:1789896051.058220:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583360 00000100:00100000:0.0:1789896051.058253:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:0.0:1789896051.058261:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003583360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.058328:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003583360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.058330:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.058342:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:0.0:1789896051.058526:0:215155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215155:1876838003583488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.058558:0:215155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.058583:0:215155:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b592d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.058608:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583488 00000100:00100000:3.0:1789896051.058613:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583488 00000100:00100000:3.0:1789896051.058642:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:3.0:1789896051.058648:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215155:x1876838003583488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896051.058710:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215155:x1876838003583488:12345-0@lo:502:llog_process_th.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.058715:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:0.0:1789896051.058745:0:215155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215155:1876838003583488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.058777:0:215155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215155:1876838003583616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.058801:0:215155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.058815:0:215155:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa452a6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896051.058819:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583616 00000100:00100000:2.0:1789896051.058823:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583616 00000100:00100000:2.0:1789896051.058848:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:2.0:1789896051.058854:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215155:x1876838003583616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.058937:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215155:x1876838003583616:12345-0@lo:502:llog_process_th.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.058945:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:0.0:1789896051.058948:0:215155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215155:1876838003583616:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896051.058975:0:215155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:2.0:1789896051.059027:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:2.0:1789896051.059048:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896051.059054:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.059061:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896051.059067:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789896051.059068:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 203 10000000:01000000:2.0:1789896051.059071:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896051.059083:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.059095:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.059102:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.059113:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.059136:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.059154:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.059169:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583744 00000100:00100000:3.0:1789896051.059173:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583744 00000100:00100000:3.0:1789896051.059192:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:3.0:1789896051.059215:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003583744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896051.059221:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896051.059230:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a25f2 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896051.059245:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896051.059255:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896051.059262:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3e00, rc 0) 00000100:00100000:3.0:1789896051.059295:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003583744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.059300:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00100000:2.0:1789896051.059312:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896051.059324:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.059332:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.059366:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.059391:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.059419:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003583872 00000100:00100000:2.0:1789896051.059420:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.059423:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003583872 00000100:00100000:0.0:1789896051.059442:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:0.0:1789896051.059446:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003583872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.059507:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003583872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.059514:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00100000:2.0:1789896051.059518:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003583872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.059545:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.059574:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.059589:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.059613:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584000 00000100:00100000:3.0:1789896051.059619:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584000 00000100:00100000:3.0:1789896051.059644:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:3.0:1789896051.059650:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003584000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.059703:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003584000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.059709:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:2.0:1789896051.059718:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.059880:0:215156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215156:1876838003584128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.059906:0:215156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.059919:0:215156:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896051.059941:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584128 00000100:00100000:2.0:1789896051.059951:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584128 00000100:00100000:2.0:1789896051.059977:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:2.0:1789896051.059985:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215156:x1876838003584128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.060066:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215156:x1876838003584128:12345-0@lo:502:llog_process_th.0 Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.060071:0:215156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215156:1876838003584128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.060077:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000020:01000000:0.0:1789896051.060092:0:215156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896051.060100:0:215156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896051.060102:0:215156:0:(obd_config.c:1561:class_process_config()) marker 193 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:0.0:1789896051.060106:0:215156:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789896051.060119:0:215156:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000100:00100000:0.0:1789896051.060130:0:215156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215156:1876838003584256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.060154:0:215156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.060167:0:215156:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.060185:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584256 00000100:00100000:3.0:1789896051.060189:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584256 00000100:00100000:3.0:1789896051.060223:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:3.0:1789896051.060233:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215156:x1876838003584256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896051.060299:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215156:x1876838003584256:12345-0@lo:502:llog_process_th.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.060305:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00100000:0.0:1789896051.060315:0:215156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215156:1876838003584256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896051.060336:0:215156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896051.060339:0:215156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896051.060340:0:215156:0:(obd_config.c:1561:class_process_config()) marker 193 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789896051.060342:0:215156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 206 count 202 00000020:01000000:2.0:1789896051.060375:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 203-205 (rc=0) 10000000:01000000:2.0:1789896051.060395:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896051.060400:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.060407:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896051.060415:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896051.060416:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 177 10000000:01000000:2.0:1789896051.060419:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896051.060432:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.060439:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.060446:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.060456:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.060478:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.060497:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584384 00000100:00100000:0.0:1789896051.060501:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584384 00000100:00100000:2.0:1789896051.060503:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.060524:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:0.0:1789896051.060535:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003584384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.060540:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.060546:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2600 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.060556:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.060561:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.060566:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b000, rc 0) 00000100:00100000:0.0:1789896051.060588:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003584384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 54us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.060593:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1789896051.060606:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896051.060618:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.060625:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.060657:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.060681:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.060697:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.060714:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584512 00000100:00100000:3.0:1789896051.060718:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584512 00000100:00100000:3.0:1789896051.060737:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:3.0:1789896051.060741:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003584512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.060788:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003584512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.060794:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1789896051.060804:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.060827:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.060855:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.060869:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.060881:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584640 00000100:00100000:0.0:1789896051.060885:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584640 00000100:00100000:0.0:1789896051.060904:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:0.0:1789896051.060908:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003584640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.060967:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003584640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.060972:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1789896051.060983:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003584640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.061168:0:215157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215157:1876838003584768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.061192:0:215157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896051.061244:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584768 00000100:00100000:0.0:1789896051.061244:0:215157:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.061250:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584768 00000100:00100000:3.0:1789896051.061281:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:3.0:1789896051.061295:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215157:x1876838003584768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896051.061370:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215157:x1876838003584768:12345-0@lo:502:llog_process_th.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.061381:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:0.0:1789896051.061381:0:215157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215157:1876838003584768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.061414:0:215157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215157:1876838003584896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.061442:0:215157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.061455:0:215157:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896051.061465:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003584896 00000100:00100000:2.0:1789896051.061470:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003584896 00000100:00100000:2.0:1789896051.061495:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:2.0:1789896051.061502:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215157:x1876838003584896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.061554:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215157:x1876838003584896:12345-0@lo:502:llog_process_th.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.061560:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00100000:0.0:1789896051.061567:0:215157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215157:1876838003584896:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896051.061585:0:215157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:2.0:1789896051.061612:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:2.0:1789896051.061628:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896051.061633:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.061642:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896051.061646:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789896051.061648:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 203 10000000:01000000:2.0:1789896051.061649:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896051.061659:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.061663:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.061667:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.061675:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.061690:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.061702:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42000 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.061730:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585024 00000100:00100000:3.0:1789896051.061735:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585024 00000100:00100000:3.0:1789896051.061767:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:3.0:1789896051.061774:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003585024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896051.061781:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896051.061790:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a260e expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896051.061805:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a260e expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896051.061814:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a260e expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896051.061822:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2800, rc 0) 00000100:00100000:3.0:1789896051.061858:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003585024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.061864:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.061868:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00010000:00010000:2.0:1789896051.061874:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896051.061880:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896051.061905:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.061918:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.061946:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.061962:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585152 00000100:00100000:0.0:1789896051.061966:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585152 00000100:00100000:0.0:1789896051.061989:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1789896051.061997:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003585152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896051.062046:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003585152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.062052:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:2.0:1789896051.062066:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.062089:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896051.062120:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.062136:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42000 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.062158:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585280 00000100:00100000:3.0:1789896051.062161:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585280 00000100:00100000:3.0:1789896051.062182:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:3.0:1789896051.062186:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003585280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.062269:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003585280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896051.062281:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.062286:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:2.0:1789896051.062437:0:215158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215158:1876838003585408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896051.062468:0:215158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896051.062488:0:215158:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948c42540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.062497:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585408 00000100:00100000:0.0:1789896051.062502:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585408 00000100:00100000:0.0:1789896051.062524:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:0.0:1789896051.062529:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215158:x1876838003585408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.062596:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215158:x1876838003585408:12345-0@lo:502:llog_process_th.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.062602:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1789896051.062610:0:215158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215158:1876838003585408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896051.062632:0:215158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896051.062638:0:215158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896051.062639:0:215158:0:(obd_config.c:1561:class_process_config()) marker 192 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789896051.062643:0:215158:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789896051.062650:0:215158:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000020:01000004:2.0:1789896051.062879:0:215159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789896051.062882:0:215159:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:0.0:1789896051.062889:0:215158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215158:1876838003585536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896051.062920:0:215158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.062947:0:215158:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.062959:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585536 00000100:00100000:3.0:1789896051.062964:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585536 00000100:00100000:3.0:1789896051.062983:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:3.0:1789896051.062987:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215158:x1876838003585536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896051.063048:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215158:x1876838003585536:12345-0@lo:502:llog_process_th.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.063054:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00100000:0.0:1789896051.063065:0:215158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215158:1876838003585536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896051.063084:0:215158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896051.063088:0:215158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896051.063089:0:215158:0:(obd_config.c:1561:class_process_config()) marker 192 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789896051.063095:0:215158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 206 count 202 00000020:01000000:1.0:1789896051.063134:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 203-205 (rc=0) 10000000:01000000:1.0:1789896051.063154:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789896051.063160:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.063168:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896051.063176:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789896051.063178:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:1.0:1789896051.063180:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789896051.063195:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.063220:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.063225:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.063235:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.063256:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896051.063275:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585664 00000100:00100000:1.0:1789896051.063279:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896051.063280:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585664 00000100:00100000:0.0:1789896051.063301:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:0.0:1789896051.063306:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003585664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896051.063312:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896051.063319:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a261c expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.063335:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a261c expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.063343:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a261c expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896051.063350:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a200, rc 0) 00000100:00100000:0.0:1789896051.063380:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003585664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896051.063385:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00000100:00100000:1.0:1789896051.063392:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896051.063403:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.063408:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896051.063443:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896051.063461:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896051.063476:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44e72240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896051.063507:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585792 00000100:00100000:3.0:1789896051.063513:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585792 00000100:00100000:3.0:1789896051.063538:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:3.0:1789896051.063546:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003585792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.063601:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003585792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789896051.063603:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003585792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896051.063615:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 10000000:01000000:1.0:1789896051.063633:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789896051.063639:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896051.063644:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896051.116402:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789896051.116425:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003585920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789896051.116496:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896051.116534:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003585920 00000100:00100000:3.0:1789896051.116542:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003585920 00000100:00100000:3.0:1789896051.116595:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789896051.116603:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003585920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789896051.116634:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789896051.116680:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003585920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896051.116686:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789896051.116728:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003585920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789896051.692336:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896052.140336:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789896052.140344:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003586048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789896052.140355:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003586176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896052.140421:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.140422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896052.140456:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586048 00000100:00100000:1.0:1789896052.140456:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586176 00000100:00100000:3.0:1789896052.140465:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586048 00000100:00100000:1.0:1789896052.140465:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586176 00000100:00080000:2.0:1789896052.140497:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896052.140515:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789896052.140515:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789896052.140525:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003586176:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896052.140529:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003586048:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1789896052.140561:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00002000:00000024:3.0:1789896052.140562:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896052.140608:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003586048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.140608:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003586176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.140616:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789896052.140617:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789896052.140651:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003586176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896052.140652:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003586048:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1789896052.229341:0:215257:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd6750a790 20000000:00000080:1.0:1789896052.229358:0:215257:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa65fa6400 uarg=0000000000000000 00000040:00100000:1.0:1789896052.229941:0:215257:0:(llog.c:1072:llog_reverse_process()) index 179 : idx 137 20000000:01000000:1.0:1789896052.229948:0:215257:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 178 cmd:0xce022 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:1.0:1789896052.229962:0:215257:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool1 fl=4 20000000:01000000:2.0:1789896052.230181:0:215258:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 173 1->4: lustre-clilov new lustre.qpool1 20000000:01000000:2.0:1789896052.230231:0:215258:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 161 marker 173 2->4: lustre-clilov new lustre.qpool1 00000040:00080000:2.0:1789896052.230244:0:215258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000040:00080000:1.0:1789896052.230351:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].181, 224 off41184 20000000:01000000:1.0:1789896052.230361:0:215257:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789896052.230377:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].182, 104 off41288 00000040:00080000:1.0:1789896052.230385:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].183, 224 off41512 20000000:01000000:1.0:1789896052.230394:0:215257:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:2.0:1789896052.230607:0:215259:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 185 marker 174 1->4: lustre-MDT0000-mdtlov new lustre.qpool1 20000000:01000000:2.0:1789896052.230633:0:215259:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 187 marker 174 2->4: lustre-MDT0000-mdtlov new lustre.qpool1 00000040:00080000:2.0:1789896052.230642:0:215259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 206 count 202 00000040:00080000:1.0:1789896052.230703:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].206, 224 off45984 20000000:01000000:1.0:1789896052.230710:0:215257:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789896052.230717:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].207, 112 off46096 00000040:00080000:1.0:1789896052.230725:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].208, 224 off46320 20000000:01000000:1.0:1789896052.230731:0:215257:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:2.0:1789896052.230913:0:215260:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 185 marker 175 1->4: lustre-MDT0001-mdtlov new lustre.qpool1 20000000:01000000:2.0:1789896052.230938:0:215260:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 187 marker 175 2->4: lustre-MDT0001-mdtlov new lustre.qpool1 00000040:00080000:2.0:1789896052.230946:0:215260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 206 count 202 00000040:00080000:1.0:1789896052.230999:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].206, 224 off45984 20000000:01000000:1.0:1789896052.231006:0:215257:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789896052.231013:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].207, 112 off46096 00000040:00080000:1.0:1789896052.231021:0:215257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].208, 224 off46320 10000000:01000000:1.0:1789896052.231027:0:215257:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789896052.231042:0:215257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231056:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231062:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231067:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231070:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231074:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231085:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231089:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231092:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231096:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231099:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a260e expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231103:0:215257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a261c expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231108:0:215257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231137:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a261c expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231146:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a261c expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231157:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586304:0@lo:104: 00000100:00100000:1.0:1789896052.231357:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.231393:0:200085:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789896052.231405:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586304 00010000:00010000:1.0:1789896052.231406:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a260e expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.231412:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586304 00010000:00010000:1.0:1789896052.231414:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a260e expref: 23 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231422:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586432:0@lo:104: 00000100:00100000:1.0:1789896052.231439:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.231455:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586432 00000100:00100000:2.0:1789896052.231459:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586432 00010000:00010000:1.0:1789896052.231463:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231470:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231478:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586560:0@lo:104: 00000100:00100000:2.0:1789896052.231483:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1789896052.231495:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1789896052.231496:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94db39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003586304:12345-0@lo:104: 00000100:00100000:1.0:1789896052.231497:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.231510:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586560 00000100:00100000:3.0:1789896052.231512:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003586432:12345-0@lo:104: 00010000:00010000:2.0:1789896052.231514:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231516:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586560 00010000:00010000:1.0:1789896052.231517:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231539:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 23 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.231545:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231550:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586688:0@lo:104: 00000100:00100000:0.0:1789896052.231555:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1789896052.231571:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215257:x1876838003586560:12345-0@lo:104: 00010000:00010000:2.0:1789896052.231579:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896052.231582:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.231590:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94db39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215257:x1876838003586304:12345-0@lo:104: Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.231595:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.231605:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00010000:00010000:3.0:1789896052.231612:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896052.231620:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003586432:12345-0@lo:104: Request processed in 115us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896052.231627:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.231633:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00010000:00010000:0.0:1789896052.231641:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789896052.231644:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.231645:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586688 00000100:00100000:2.0:1789896052.231650:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586688 00000100:00100000:0.0:1789896052.231651:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003586560:12345-0@lo:104: Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.231664:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586816:0@lo:104: 00000100:00100000:0.0:1789896052.231664:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00010000:00010000:3.0:1789896052.231675:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789896052.231682:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00010000:00010000:3.0:1789896052.231684:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231691:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003586688:12345-0@lo:104: 00010000:00010000:2.0:1789896052.231695:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896052.231700:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6c00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896052.231704:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.231705:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231705:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896052.231707:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.231730:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9c00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896052.231732:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896052.231735:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231741:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.231747:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:3.0:1789896052.231752:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.231755:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231758:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003586688:12345-0@lo:104: Request processed in 68us (165us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896052.231768:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 23 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231775:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 10000000:00010000:2.0:1789896052.231784:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231787:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586816 00000100:00100000:0.0:1789896052.231792:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586816 00000100:00100000:1.0:1789896052.231796:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586944:0@lo:104: 10000000:01000000:3.0:1789896052.231800:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789896052.231804:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896052.231810:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1789896052.231817:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003586816:12345-0@lo:104: 00000100:00100000:1.0:1789896052.231826:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896052.231826:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.231846:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.231848:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231860:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.231862:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896052.231870:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896052.231874:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789896052.231875:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231883:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587328:0@lo:104: 00000100:00100000:0.0:1789896052.231889:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003586816:12345-0@lo:104: Request processed in 70us (186us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896052.231892:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.231898:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231899:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1789896052.231905:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896052.231910:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a261c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2623 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.231923:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a260e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2615 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231930:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003586944 00000100:00100000:0.0:1789896052.231935:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003586944 00010000:00010000:1.0:1789896052.231940:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.231944:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896052.231949:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896052.231951:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231952:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587328 00010000:00010000:2.0:1789896052.231954:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.231956:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 23 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.231956:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587328 00000100:00100000:0.0:1789896052.231969:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00010000:00010000:3.0:1789896052.231975:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8200 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896052.231980:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8a00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:0.0:1789896052.231980:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003586944:12345-0@lo:104: 10000000:00010000:3.0:1789896052.231982:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.231984:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587456:0@lo:104: 10000000:00010000:2.0:1789896052.231989:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.231997:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232006:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232008:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232013:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896052.232031:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896052.232032:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896052.232033:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232045:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232049:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:2.0:1789896052.232052:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789896052.232057:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896052.232062:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003586944:12345-0@lo:104: Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.232076:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1789896052.232082:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587584:0@lo:104: 00010000:00010000:2.0:1789896052.232090:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232094:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232094:0:188715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789896052.232096:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896052.232106:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896052.232106:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232107:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587456 00000100:00100000:0.0:1789896052.232112:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587456 00010000:00010000:2.0:1789896052.232119:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a25f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25f9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232119:0:215257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896052.232124:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232132:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587584 00010000:00010000:3.0:1789896052.232134:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2607 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232134:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789896052.232136:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587584 00010000:00010000:2.0:1789896052.232140:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232146:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232152:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00010000:00010000:3.0:1789896052.232156:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896052.232159:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9000 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896052.232163:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896052.232166:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232166:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215257:x1876838003587328:12345-0@lo:104: 00010000:00010000:1.0:1789896052.232168:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 9 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232183:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232187:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896052.232189:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896052.232195:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232195:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587968:192.168.202.44@tcp:104: 10000000:00010000:2.0:1789896052.232221:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.232237:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896052.232242:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896052.232254:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896052.232260:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896052.232260:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232261:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896052.232272:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896052.232273:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215257:x1876838003587328:12345-0@lo:104: Request processed in 109us (370us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896052.232279:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232282:0:215257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232295:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232304:0:215257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 9 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232306:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:2.0:1789896052.232311:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a25e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25eb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232319:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896052.232326:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789896052.232330:0:215257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003588224:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896052.232331:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232333:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789896052.232337:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fa38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003587456:12345-0@lo:104: 00010000:00010000:2.0:1789896052.232340:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232350:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232353:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a25d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25dd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232356:0:215257:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00010000:00010000:2.0:1789896052.232357:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896052.232364:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232374:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232378:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586304:0@lo:104: 00010000:00010000:0.0:1789896052.232390:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789896052.232392:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232395:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586432:0@lo:104: 00000100:00100000:0.0:1789896052.232400:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fa38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215257:x1876838003587456:12345-0@lo:104: Request processed in 64us (388us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896052.232401:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789896052.232408:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896052.232409:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232409:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586560:0@lo:104: 00000100:00100000:0.0:1789896052.232418:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789896052.232423:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586688:0@lo:104: 00010000:00010000:3.0:1789896052.232426:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7a00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896052.232431:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232437:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232440:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232444:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896052.232445:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586816:0@lo:104: 00010000:00010000:2.0:1789896052.232452:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896052.232457:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232458:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1789896052.232464:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003586944:0@lo:104: 00010000:00010000:2.0:1789896052.232469:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a25c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25cf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232471:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003587584:12345-0@lo:104: 10000000:01000000:3.0:1789896052.232479:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896052.232483:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232484:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587328:0@lo:104: 00010000:00010000:2.0:1789896052.232488:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896052.232497:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896052.232501:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896052.232512:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.232518:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003587200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896052.232521:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587456:0@lo:104: 00010000:00010000:3.0:1789896052.232524:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896052.232528:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789896052.232532:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232538:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215257:x1876838003587584:12345-0@lo:104: Request processed in 68us (418us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896052.232544:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a25ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25c1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232547:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587584:0@lo:104: 00000100:00100000:0.0:1789896052.232552:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789896052.232560:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896052.232568:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896052.232573:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.232583:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003588352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896052.232591:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587200 00000100:00100000:0.0:1789896052.232596:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587200 00010000:00010000:3.0:1789896052.232597:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896052.232598:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003587072:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789896052.232603:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232611:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232616:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a260e expref: 24 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.232621:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896052.232630:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232636:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789896052.232637:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896052.232647:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588352 00010000:00010000:1.0:1789896052.232648:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896052.232650:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588352 00000100:00100000:2.0:1789896052.232655:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:1.0:1789896052.232657:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896052.232664:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003587712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896052.232666:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232666:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 25 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.232682:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896052.232693:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896052.232694:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232697:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896052.232704:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a25ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a25b3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.232717:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003588480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896052.232724:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587712 00010000:00010000:3.0:1789896052.232725:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896052.232730:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896052.232731:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587712 00000100:00100000:0.0:1789896052.232732:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00010000:00010000:3.0:1789896052.232734:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896052.232745:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3615:x1876838003587200:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896052.232747:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896052.232754:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 26 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.232755:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003587840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896052.232761:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896052.232771:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a260e expref: 26 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.232780:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588480 00000100:00100000:1.0:1789896052.232785:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588480 00010000:00010000:0.0:1789896052.232785:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a260e expref: 26 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.232798:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896052.232804:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 27 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232804:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a260e expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.232817:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003588608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896052.232831:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587840 00010000:00010000:0.0:1789896052.232831:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896052.232837:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587840 00000100:00100000:3.0:1789896052.232845:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896052.232852:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 27 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.232872:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588608 00000100:00100000:2.0:1789896052.232878:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588608 00000100:00100000:3.0:1789896052.232879:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789896052.232883:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789896052.232884:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003587200:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.232891:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003588736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896052.232896:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1789896052.232899:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3615:x1876838003588352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.232902:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 28 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.232912:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896052.232930:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00010000:00010000:1.0:1789896052.232931:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.232939:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003587712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896052.232946:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.232947:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896052.232948:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00010000:00010000:0.0:1789896052.232956:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.232962:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003588480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.232976:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896052.232980:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.232984:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 27 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.232992:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896052.233004:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a25dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a25d6 expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.233009:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a25f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a25f2 expref: 27 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.233011:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 27 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.233031:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896052.233037:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a25cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a25c8 expref: 26 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.233044:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896052.233047:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896052.233063:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003588096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.233066:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896052.233073:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3615:x1876838003588352:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.233080:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3615:x1876838003587712:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.233084:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789896052.233092:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1789896052.233102:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.233107:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003588480:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.233109:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588736 00000100:00100000:0.0:1789896052.233112:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003587072 00000100:00100000:1.0:1789896052.233115:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588736 00000100:00100000:2.0:1789896052.233116:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789896052.233117:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003587072 00000100:00100000:2.0:1789896052.233136:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588096 00010000:00010000:0.0:1789896052.233140:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a261c expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.233141:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588096 00010000:00010000:1.0:1789896052.233141:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.233150:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00010000:00010000:2.0:1789896052.233156:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.233167:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003587840:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896052.233174:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789896052.233181:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1789896052.233186:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003588608:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896052.233190:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789896052.233219:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003588736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.233227:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896052.233227:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896052.233233:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.233237:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 24 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.233238:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003587072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.233243:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.233254:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896052.233265:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a261c expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.233266:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 24 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.233268:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896052.233278:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.233293:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a25b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a25ac expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.233296:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a261c expref: 24 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.233313:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a25c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a25ba expref: 23 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.233315:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 23 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.233334:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896052.233343:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a2623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a261c expref: 22 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.233346:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896052.233348:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2600 expref: 22 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.233360:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003588736:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (371us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896052.233364:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896052.233369:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896052.233370:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1789896052.233391:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3617:x1876838003588608:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896052.233392:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1789896052.233403:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1789896052.233406:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3618:x1876838003588096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896052.233417:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003587840:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.233420:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3618:x1876838003587072:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (378us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896052.233429:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896052.233435:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00010000:00010000:2.0:1789896052.233440:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 18 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.233445:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1789896052.233450:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003587712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.233456:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 17 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.233472:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a25eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a25e4 expref: 16 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896052.233473:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003588480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896052.233477:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003587072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.233486:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896052.233505:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003587200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896052.233519:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003588352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896052.233531:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003588096:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.233537:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003588736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896052.233544:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1789896052.233553:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003587840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896052.233563:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003588608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896052.233590:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003588096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896052.233695:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003587968:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896052.233705:0:215257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215257:1876838003588224:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896052.233737:0:215257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.233893:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896052.233939:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962752 00000100:00100000:0.0:1789896052.233944:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962752 00010000:00010000:0.0:1789896052.233962:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 10 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896052.233978:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896052.233996:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962624 00000100:00100000:0.0:1789896052.234000:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962624 00010000:00010000:0.0:1789896052.234014:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 11 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.234017:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 548 00000100:00100000:1.0:1789896052.234031:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015962752:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896052.234037:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 549 00010000:00010000:1.0:1789896052.234042:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896052.234050:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 11 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.234051:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015962624:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896052.234067:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896052.234068:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 11 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234078:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 11 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.234087:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a25a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f640 expref: 11 pid: 188723 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234093:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 11 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.234104:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896052.234110:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a259e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f639 expref: 10 pid: 188725 timeout: 4024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234124:0:199629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234138:0:199629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.234141:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015962752:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 112us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.234155:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 548 00010000:00010000:2.0:1789896052.234158:0:199629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234167:0:199629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234174:0:199629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234181:0:199629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234186:0:199629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6e00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:2.0:1789896052.234192:0:199629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234222:0:199629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234236:0:199629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.234247:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896052.234254:0:215257:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.234265:0:215257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.234273:0:215257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6e00/0x412fd4b3617a262a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.234277:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+8:2403:x1876838015962624:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 230us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896052.234292:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 549 10000000:01000000:1.0:1789896052.452281:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896052.452289:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 180 10000000:01000000:1.0:1789896052.452294:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896052.452342:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.452351:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.452359:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.452382:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003588864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896052.452449:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.452498:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.452522:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588864 00000100:00100000:0.0:1789896052.452531:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588864 00000100:00100000:0.0:1789896052.452592:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1789896052.452607:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003588864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896052.452620:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896052.452634:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2631 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.452656:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.452667:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.452675:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a800, rc 0) 00000100:00100000:0.0:1789896052.452721:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003588864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.452741:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:1.0:1789896052.452759:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003588864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896052.452776:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.452787:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896052.452855:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003588992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896052.452880:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.452899:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.452972:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003588992 00000100:00100000:3.0:1789896052.452977:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003588992 00000100:00100000:3.0:1789896052.453008:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:3.0:1789896052.453016:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003588992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.453135:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003588992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.453143:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:1.0:1789896052.453162:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003588992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896052.453192:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896052.453248:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.453267:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.453291:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589120 00000100:00100000:0.0:1789896052.453296:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589120 00000100:00100000:0.0:1789896052.453320:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:0.0:1789896052.453327:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003589120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.453409:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003589120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.453414:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.453420:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:1.0:1789896052.453721:0:215261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215261:1876838003589248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.453752:0:215261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.453771:0:215261:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.453797:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589248 00000100:00100000:3.0:1789896052.453803:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589248 00000100:00100000:3.0:1789896052.453828:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:3.0:1789896052.453835:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215261:x1876838003589248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.453933:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215261:x1876838003589248:12345-0@lo:502:llog_process_th.0 Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.453941:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:1.0:1789896052.453943:0:215261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215261:1876838003589248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.453986:0:215261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215261:1876838003589376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.454013:0:215261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.454028:0:215261:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7371c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.454056:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589376 00000100:00100000:0.0:1789896052.454061:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589376 00000100:00100000:0.0:1789896052.454086:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310 00000100:00100000:0.0:1789896052.454093:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215261:x1876838003589376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.454158:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215261:x1876838003589376:12345-0@lo:502:llog_process_th.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.454165:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310 00000100:00100000:1.0:1789896052.454169:0:215261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215261:1876838003589376:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896052.454191:0:215261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789896052.454295:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789896052.454321:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896052.454328:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.454337:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.454344:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789896052.454346:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:2.0:1789896052.454348:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896052.454363:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.454369:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.454377:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.454389:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.454414:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.454442:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.454466:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589504 00000100:00100000:3.0:1789896052.454471:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589504 00000100:00100000:3.0:1789896052.454499:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:3.0:1789896052.454507:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003589504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896052.454514:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896052.454523:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a263f expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.454537:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a263f expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.454557:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a263f expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.454564:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2200, rc 0) 00000100:00100000:3.0:1789896052.454594:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003589504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.454601:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1789896052.454627:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.454641:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.454650:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.454688:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.454732:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.454748:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.454776:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589632 00000100:00100000:0.0:1789896052.454781:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589632 00000100:00100000:0.0:1789896052.454806:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:0.0:1789896052.454813:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003589632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.454878:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003589632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.454885:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00100000:2.0:1789896052.454910:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.454948:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.454979:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.454995:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.455013:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589760 00000100:00100000:3.0:1789896052.455017:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589760 00000100:00100000:3.0:1789896052.455037:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313 00000100:00100000:3.0:1789896052.455040:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003589760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.455103:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003589760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.455108:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313 00000100:00100000:2.0:1789896052.455133:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896052.455853:0:215262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:2.0:1789896052.455930:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:2.0:1789896052.455945:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789896052.455951:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.455958:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.455965:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896052.455967:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 180 10000000:01000000:2.0:1789896052.455969:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896052.455982:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.455989:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.455996:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.456007:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.456036:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.456058:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.456069:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003589888 00000100:00100000:0.0:1789896052.456074:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003589888 00000100:00100000:0.0:1789896052.456100:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:0.0:1789896052.456112:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003589888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896052.456120:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896052.456127:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a264d expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.456140:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a264d expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.456147:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a264d expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.456155:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b400, rc 0) 00000100:00100000:0.0:1789896052.456187:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003589888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.456193:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00100000:2.0:1789896052.456235:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003589888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.456245:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.456251:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.456278:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.456297:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.456314:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.456330:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590016 00000100:00100000:3.0:1789896052.456335:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590016 00000100:00100000:3.0:1789896052.456355:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:3.0:1789896052.456359:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003590016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.456405:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003590016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 45us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.456411:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:2.0:1789896052.456432:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.456459:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.456492:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.456508:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.456526:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590144 00000100:00100000:0.0:1789896052.456532:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590144 00000100:00100000:0.0:1789896052.456556:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1789896052.456562:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003590144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.456625:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003590144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.456634:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:2.0:1789896052.456650:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.456828:0:215263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215263:1876838003590272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.456864:0:215263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.456882:0:215263:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa41377540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.456897:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590272 00000100:00100000:3.0:1789896052.456901:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590272 00000100:00100000:3.0:1789896052.456929:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:3.0:1789896052.456934:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215263:x1876838003590272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.456993:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215263:x1876838003590272:12345-0@lo:502:llog_process_th.0 Request processed in 59us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.456998:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:0.0:1789896052.457020:0:215263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215263:1876838003590272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.457055:0:215263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215263:1876838003590400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.457087:0:215263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.457106:0:215263:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa41377540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896052.457121:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590400 00000100:00100000:2.0:1789896052.457125:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590400 00000100:00100000:2.0:1789896052.457144:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:2.0:1789896052.457149:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215263:x1876838003590400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896052.457227:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215263:x1876838003590400:12345-0@lo:502:llog_process_th.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896052.457233:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:0.0:1789896052.457246:0:215263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215263:1876838003590400:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896052.457270:0:215263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789896052.457309:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789896052.457331:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896052.457336:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.457342:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.457347:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789896052.457348:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789896052.457349:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896052.457359:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.457363:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.457368:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.457376:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.457392:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.457408:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.457424:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590528 00000100:00100000:3.0:1789896052.457428:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590528 00000100:00100000:3.0:1789896052.457447:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319 00000100:00100000:3.0:1789896052.457451:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003590528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896052.457455:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896052.457462:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a265b expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.457472:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a265b expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.457478:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a265b expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.457482:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2600, rc 0) 00000100:00100000:3.0:1789896052.457506:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003590528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.457511:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319 00000100:00100000:2.0:1789896052.457522:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.457532:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.457537:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.457560:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.457588:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.457605:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.457623:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590656 00000100:00100000:0.0:1789896052.457627:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590656 00000100:00100000:0.0:1789896052.457652:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:0.0:1789896052.457658:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003590656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.457721:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003590656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.457728:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00100000:2.0:1789896052.457747:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.457765:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.457790:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.457802:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.457827:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590784 00000100:00100000:3.0:1789896052.457832:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590784 00000100:00100000:3.0:1789896052.457857:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1789896052.457865:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003590784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.457934:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003590784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.457946:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:2.0:1789896052.457956:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896052.458604:0:215264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789896052.458672:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789896052.458687:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789896052.458691:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.458697:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.458702:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896052.458703:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 180 10000000:01000000:2.0:1789896052.458704:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896052.458714:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.458718:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.458723:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.458730:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.458752:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.458768:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.458786:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003590912 00000100:00100000:0.0:1789896052.458791:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003590912 00000100:00100000:0.0:1789896052.458816:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1789896052.458823:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003590912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896052.458829:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896052.458837:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2669 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.458850:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.458858:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.458864:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5be00, rc 0) 00000100:00100000:0.0:1789896052.458896:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003590912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.458909:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:2.0:1789896052.458927:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003590912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.458936:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.458942:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.458967:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.458984:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.458996:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.459025:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591040 00000100:00100000:3.0:1789896052.459029:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591040 00000100:00100000:3.0:1789896052.459047:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:3.0:1789896052.459051:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003591040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.459099:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003591040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.459104:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1789896052.459123:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.459149:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.459174:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.459186:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.459220:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591168 00000100:00100000:0.0:1789896052.459226:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591168 00000100:00100000:0.0:1789896052.459263:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:0.0:1789896052.459270:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003591168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.459333:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003591168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.459341:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:2.0:1789896052.459354:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.459564:0:215265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215265:1876838003591296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.459596:0:215265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.459620:0:215265:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.459635:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591296 00000100:00100000:3.0:1789896052.459639:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591296 00000100:00100000:3.0:1789896052.459659:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:3.0:1789896052.459662:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215265:x1876838003591296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.459717:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215265:x1876838003591296:12345-0@lo:502:llog_process_th.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.459722:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:0.0:1789896052.459744:0:215265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215265:1876838003591296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.459779:0:215265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215265:1876838003591424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.459809:0:215265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.459826:0:215265:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896052.459847:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591424 00000100:00100000:2.0:1789896052.459851:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591424 00000100:00100000:2.0:1789896052.459871:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:2.0:1789896052.459875:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215265:x1876838003591424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896052.459940:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215265:x1876838003591424:12345-0@lo:502:llog_process_th.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896052.459945:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00100000:0.0:1789896052.459968:0:215265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215265:1876838003591424:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896052.459989:0:215265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789896052.460037:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789896052.460062:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896052.460067:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.460075:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.460082:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789896052.460083:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 206 10000000:01000000:2.0:1789896052.460085:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896052.460096:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.460101:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.460106:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.460113:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.460130:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.460142:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.460164:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591552 00000100:00100000:3.0:1789896052.460168:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591552 00000100:00100000:3.0:1789896052.460186:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:3.0:1789896052.460190:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003591552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896052.460195:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896052.460220:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2677 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.460231:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.460238:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.460249:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2e00, rc 0) 00000100:00100000:3.0:1789896052.460282:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003591552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.460291:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:2.0:1789896052.460296:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.460308:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.460314:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.460351:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.460378:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.460398:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.460407:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591680 00000100:00100000:0.0:1789896052.460412:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591680 00000100:00100000:0.0:1789896052.460438:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:0.0:1789896052.460445:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003591680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.460507:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003591680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.460514:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1789896052.460518:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.460544:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.460569:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.460581:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.460610:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591808 00000100:00100000:3.0:1789896052.460615:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591808 00000100:00100000:3.0:1789896052.460641:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:3.0:1789896052.460648:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003591808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.460720:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003591808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.460727:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1789896052.460741:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003591808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896052.460969:0:215266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215266:1876838003591936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.461009:0:215266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.461028:0:215266:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.461043:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003591936 00000100:00100000:0.0:1789896052.461048:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003591936 00000100:00100000:0.0:1789896052.461071:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1789896052.461078:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215266:x1876838003591936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.461152:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215266:x1876838003591936:12345-0@lo:502:llog_process_th.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.461158:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1789896052.461165:0:215266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215266:1876838003591936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896052.461193:0:215266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896052.461226:0:215266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896052.461229:0:215266:0:(obd_config.c:1561:class_process_config()) marker 196 (0x1) lustre-MDT0001-m del lustre.qpool1 00000020:00000080:1.0:1789896052.461235:0:215266:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1789896052.461304:0:215266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215266:1876838003592064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.461336:0:215266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.461358:0:215266:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa41254000 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.461380:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592064 00000100:00100000:3.0:1789896052.461385:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592064 00000100:00100000:3.0:1789896052.461409:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:3.0:1789896052.461416:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215266:x1876838003592064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.461487:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215266:x1876838003592064:12345-0@lo:502:llog_process_th.0 Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.461495:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00100000:1.0:1789896052.461501:0:215266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215266:1876838003592064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896052.461531:0:215266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896052.461536:0:215266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896052.461538:0:215266:0:(obd_config.c:1561:class_process_config()) marker 196 (0x2) lustre-MDT0001-m del lustre.qpool1 00000040:00080000:1.0:1789896052.461542:0:215266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 209 count 205 00000020:01000000:2.0:1789896052.461599:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 206-208 (rc=0) 10000000:01000000:2.0:1789896052.461617:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896052.461621:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.461626:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.461632:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896052.461633:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 180 10000000:01000000:2.0:1789896052.461634:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896052.461645:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.461649:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.461654:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.461661:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.461683:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.461696:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.461716:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592192 00000100:00100000:0.0:1789896052.461721:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592192 00000100:00100000:0.0:1789896052.461746:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1789896052.461752:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003592192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896052.461759:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896052.461766:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2685 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.461779:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.461787:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896052.461794:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a200, rc 0) 00000100:00100000:0.0:1789896052.461825:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003592192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.461831:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:2.0:1789896052.461848:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.461857:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.461862:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.461885:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.461901:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.461923:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.461942:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592320 00000100:00100000:3.0:1789896052.461946:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592320 00000100:00100000:3.0:1789896052.461965:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:3.0:1789896052.461968:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003592320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.462018:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003592320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.462024:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:2.0:1789896052.462031:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.462052:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.462076:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.462090:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.462111:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592448 00000100:00100000:0.0:1789896052.462115:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592448 00000100:00100000:0.0:1789896052.462137:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:0.0:1789896052.462141:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003592448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.462231:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003592448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896052.462234:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.462241:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:0.0:1789896052.462442:0:215267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215267:1876838003592576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.462475:0:215267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.462501:0:215267:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.462508:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592576 00000100:00100000:3.0:1789896052.462512:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592576 00000100:00100000:3.0:1789896052.462531:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1789896052.462535:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215267:x1876838003592576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.462589:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215267:x1876838003592576:12345-0@lo:502:llog_process_th.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.462593:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:0.0:1789896052.462618:0:215267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215267:1876838003592576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.462651:0:215267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215267:1876838003592704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.462680:0:215267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.462699:0:215267:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896052.462729:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592704 00000100:00100000:2.0:1789896052.462735:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592704 00000100:00100000:2.0:1789896052.462762:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:2.0:1789896052.462775:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215267:x1876838003592704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896052.462843:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215267:x1876838003592704:12345-0@lo:502:llog_process_th.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896052.462850:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00100000:0.0:1789896052.462867:0:215267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215267:1876838003592704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896052.462891:0:215267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789896052.462950:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789896052.462975:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896052.462980:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.462988:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.462994:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789896052.462996:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 206 10000000:01000000:2.0:1789896052.462999:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896052.463011:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.463018:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.463024:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.463036:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.463058:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.463073:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.463094:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592832 00000100:00100000:3.0:1789896052.463098:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592832 00000100:00100000:3.0:1789896052.463116:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:3.0:1789896052.463120:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003592832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896052.463125:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896052.463131:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2693 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.463141:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.463147:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896052.463152:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3000, rc 0) 00000100:00100000:3.0:1789896052.463174:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003592832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.463178:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:2.0:1789896052.463218:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.463233:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.463240:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.463276:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.463304:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896052.463328:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003592960 00000100:00100000:2.0:1789896052.463331:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.463334:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003592960 00000100:00100000:0.0:1789896052.463363:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:0.0:1789896052.463370:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003592960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896052.463433:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003592960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896052.463442:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:2.0:1789896052.463453:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003592960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.463477:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003593088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.463506:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.463523:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.463540:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003593088 00000100:00100000:3.0:1789896052.463544:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003593088 00000100:00100000:3.0:1789896052.463563:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1789896052.463567:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003593088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.463620:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003593088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896052.463625:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:2.0:1789896052.463644:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003593088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896052.463821:0:215268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215268:1876838003593216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.463858:0:215268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.463876:0:215268:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896052.463893:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003593216 00000100:00100000:0.0:1789896052.463898:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003593216 00000100:00100000:0.0:1789896052.463930:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:0.0:1789896052.463936:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215268:x1876838003593216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.464008:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215268:x1876838003593216:12345-0@lo:502:llog_process_th.0 Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.464021:0:215268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215268:1876838003593216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896052.464022:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000020:01000000:1.0:1789896052.464050:0:215268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896052.464057:0:215268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896052.464059:0:215268:0:(obd_config.c:1561:class_process_config()) marker 195 (0x1) lustre-MDT0000-m del lustre.qpool1 00000020:00000080:1.0:1789896052.464063:0:215268:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1789896052.464769:0:215268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215268:1876838003593344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896052.464797:0:215268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896052.464817:0:215268:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.464845:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003593344 00000100:00100000:3.0:1789896052.464850:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003593344 00000100:00100000:3.0:1789896052.464877:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:3.0:1789896052.464886:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215268:x1876838003593344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.464972:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215268:x1876838003593344:12345-0@lo:502:llog_process_th.0 Request processed in 86us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.464978:0:215268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215268:1876838003593344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896052.464982:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00000020:01000000:1.0:1789896052.464999:0:215268:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896052.465003:0:215268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896052.465004:0:215268:0:(obd_config.c:1561:class_process_config()) marker 195 (0x2) lustre-MDT0000-m del lustre.qpool1 00000040:00080000:1.0:1789896052.465007:0:215268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 209 count 205 00000020:01000000:2.0:1789896052.465061:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 206-208 (rc=0) 10000000:01000000:2.0:1789896052.465077:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896052.465082:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.465091:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896052.465098:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896052.465100:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896052.465103:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896052.465118:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.465125:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.465132:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.465143:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003593472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.465176:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.465220:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896052.465225:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003593472 00000100:00100000:1.0:1789896052.465230:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003593472 00000100:00100000:1.0:1789896052.465262:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1789896052.465270:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003593472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896052.465278:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896052.465287:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a26a1 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.465305:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.465311:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.465316:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7400, rc 0) 00000100:00100000:1.0:1789896052.465344:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003593472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896052.465351:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:2.0:1789896052.465374:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003593472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896052.465385:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.465392:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896052.465425:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003593600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896052.465448:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896052.465469:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896052.465483:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003593600 00000100:00100000:3.0:1789896052.465487:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003593600 00000100:00100000:3.0:1789896052.465505:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:3.0:1789896052.465511:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003593600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896052.465548:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003593600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 38us (99us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896052.465553:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:2.0:1789896052.465567:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003593600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789896052.465590:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896052.465595:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896052.465602:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896052.716376:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896053.363389:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.363454:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015962880 00000100:00100000:1.0:1789896053.363464:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015962880 00000100:00100000:1.0:1789896053.363508:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2344 00000100:00100000:1.0:1789896053.363516:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015962880:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896053.363530:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896053.363546:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f647 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896053.363570:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896053.363578:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896053.363585:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7e00, rc 0) 00000100:00100000:1.0:1789896053.363634:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015962880:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 118us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896053.363645:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2344 00000100:00100000:0.0:1789896053.364310:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.364365:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963008 00000100:00100000:1.0:1789896053.364371:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963008 00000100:00100000:1.0:1789896053.364402:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2345 00000100:00100000:1.0:1789896053.364410:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015963008:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896053.364530:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015963008:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 120us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896053.364537:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2345 00000100:00100000:2.0:1789896053.365232:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.365279:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963136 00000100:00100000:1.0:1789896053.365284:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963136 00000100:00100000:1.0:1789896053.365313:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2346 00000100:00100000:1.0:1789896053.365322:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015963136:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896053.365407:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015963136:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896053.365416:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2346 00000100:00100000:2.0:1789896053.366452:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.366497:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963264 00000100:00100000:1.0:1789896053.366502:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963264 00000100:00100000:1.0:1789896053.366529:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2347 00000100:00100000:1.0:1789896053.366537:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:214512:x1876838015963264:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789896053.366626:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:214512:x1876838015963264:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896053.366635:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2347 00000100:00100000:0.0:1789896053.367318:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.367363:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963392 00000100:00100000:1.0:1789896053.367369:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963392 00000100:00100000:1.0:1789896053.367403:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2348 00000100:00100000:1.0:1789896053.367410:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214512:x1876838015963392:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789896053.367473:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214512:x1876838015963392:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896053.367482:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2348 00000100:00100000:0.0:1789896053.368306:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.368349:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963520 00000100:00100000:1.0:1789896053.368354:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963520 00000100:00100000:1.0:1789896053.368382:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2349 00000100:00100000:1.0:1789896053.368394:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015963520:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896053.368404:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896053.368418:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f64e expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896053.368439:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896053.368450:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896053.368458:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6400, rc 0) 00000100:00100000:1.0:1789896053.368488:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015963520:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 100us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896053.368496:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2349 00000100:00100000:2.0:1789896053.369244:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896053.369295:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963648 00000100:00100000:1.0:1789896053.369300:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963648 00000100:00100000:1.0:1789896053.369328:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2350 00000100:00100000:1.0:1789896053.369335:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015963648:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896053.369403:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015963648:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 69us (160us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789896053.369410:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2350 00010000:00010000:1.0:1789896053.740336:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789896054.428134:0:215462:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe4badbb20 20000000:00000080:2.0:1789896054.428155:0:215462:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa7fa38000 uarg=0000000000000000 00000040:00100000:2.0:1789896054.429258:0:215462:0:(llog.c:1072:llog_reverse_process()) index 183 : idx 181 00000040:00100000:2.0:1789896054.429269:0:215462:0:(llog.c:1072:llog_reverse_process()) index 179 : idx 137 20000000:01000000:2.0:1789896054.429279:0:215462:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 172 cmd:0xce021 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:2.0:1789896054.429294:0:215462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789896054.429561:0:215463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 171 marker 185 1->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:0.0:1789896054.429621:0:215463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 173 marker 185 2->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789896054.429639:0:215463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000040:00080000:2.0:1789896054.429762:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].184, 224 off41736 20000000:01000000:2.0:1789896054.429777:0:215462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789896054.429791:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].185, 128 off41864 00000040:00080000:2.0:1789896054.429808:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].186, 224 off42088 20000000:01000000:2.0:1789896054.429820:0:215462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789896054.430045:0:215464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 197 marker 186 1->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:0.0:1789896054.430060:0:215464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 199 marker 186 2->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789896054.430069:0:215464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 209 count 205 00000040:00080000:2.0:1789896054.430154:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].209, 224 off46544 20000000:01000000:2.0:1789896054.430164:0:215462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789896054.430179:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].210, 136 off46680 00000040:00080000:2.0:1789896054.430193:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].211, 224 off46904 20000000:01000000:2.0:1789896054.430233:0:215462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789896054.430462:0:215465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 197 marker 187 1->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:0.0:1789896054.430481:0:215465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 199 marker 187 2->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789896054.430498:0:215465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 209 count 205 00000040:00080000:2.0:1789896054.430578:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].209, 224 off46544 20000000:01000000:2.0:1789896054.430588:0:215462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789896054.430600:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].210, 136 off46680 00000040:00080000:2.0:1789896054.430614:0:215462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].211, 224 off46904 10000000:01000000:2.0:1789896054.430625:0:215462:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896054.430645:0:215462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430666:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430675:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a263f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430683:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a264d expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430690:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a265b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430708:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430716:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430724:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430731:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430738:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430749:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430757:0:215462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430765:0:215462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430806:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430823:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 9 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.430850:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003593728:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896054.430968:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.430979:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 9 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.430989:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003593856:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896054.431021:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.431031:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 23 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431042:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003593984:0@lo:104: 00000100:00100000:2.0:1789896054.431084:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896054.431114:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431115:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003593984 00000100:00100000:0.0:1789896054.431125:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003593984 00010000:00010000:2.0:1789896054.431128:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431139:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594112:0@lo:104: 00000100:00100000:2.0:1789896054.431163:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896054.431181:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594112 00000100:00100000:0.0:1789896054.431185:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594112 00000100:00100000:3.0:1789896054.431194:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00010000:00010000:2.0:1789896054.431225:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.431248:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003593984:12345-0@lo:104: 00010000:00010000:2.0:1789896054.431248:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 23 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.431249:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00010000:00010000:3.0:1789896054.431267:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431269:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594240:0@lo:104: 00000100:00100000:1.0:1789896054.431270:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003594112:12345-0@lo:104: 00010000:00010000:1.0:1789896054.431287:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431302:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896054.431327:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594240 00000100:00100000:0.0:1789896054.431333:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594240 00010000:00010000:3.0:1789896054.431350:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896054.431350:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431359:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896054.431362:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215462:x1876838003593984:12345-0@lo:104: Request processed in 117us (275us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896054.431367:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.431370:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215462:x1876838003594112:12345-0@lo:104: Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896054.431370:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789896054.431386:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789896054.431387:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215462:x1876838003594240:12345-0@lo:104: 00000100:00100000:2.0:1789896054.431389:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594368:0@lo:104: 00010000:00010000:0.0:1789896054.431403:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431410:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789896054.431416:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431425:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896054.431428:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8600 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896054.431434:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431445:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.431458:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00010000:2.0:1789896054.431459:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896054.431460:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.431462:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896054.431472:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594368 00000100:00100000:0.0:1789896054.431475:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215462:x1876838003594240:12345-0@lo:104: Request processed in 89us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896054.431477:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594368 10000000:01000000:1.0:1789896054.431481:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896054.431483:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 23 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.431496:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1789896054.431506:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003594368:12345-0@lo:104: 00000100:00100000:2.0:1789896054.431509:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594496:0@lo:104: 00000100:00100000:0.0:1789896054.431510:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00010000:00010000:3.0:1789896054.431517:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431521:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431531:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896054.431541:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896054.431553:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431559:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a26a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26a8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431564:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003594624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896054.431568:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789896054.431570:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789896054.431574:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.431577:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215462:x1876838003594368:12345-0@lo:104: Request processed in 70us (154us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896054.431579:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a265b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431584:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9600 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896054.431589:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.431595:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00010000:00010000:2.0:1789896054.431605:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a265b expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431605:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896054.431607:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.431613:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594496 00000100:00100000:3.0:1789896054.431620:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594496 00000100:00100000:2.0:1789896054.431630:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594752:0@lo:104: 10000000:00010000:1.0:1789896054.431634:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896054.431645:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896054.431660:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00010000:00010000:1.0:1789896054.431661:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431668:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896054.431679:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789896054.431679:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215462:x1876838003594496:12345-0@lo:104: 00010000:00010000:1.0:1789896054.431680:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431681:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896054.431688:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.431697:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.431700:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896054.431707:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.431712:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a264d expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431715:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a2693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a269a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.431731:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.431735:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a264d expref: 23 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431742:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789896054.431743:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789896054.431751:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896054.431752:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431755:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215462:x1876838003594496:12345-0@lo:104: Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896054.431757:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003595008:0@lo:104: 10000000:01000000:3.0:1789896054.431774:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896054.431774:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00010000:00010000:1.0:1789896054.431776:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896054.431780:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431790:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431791:0:188715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789896054.431800:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a263f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896054.431801:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.431804:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431814:0:188715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789896054.431821:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896054.431823:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896054.431825:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594752 00010000:00010000:2.0:1789896054.431827:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a263f expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431829:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594752 00000100:00100000:2.0:1789896054.431842:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003595136:0@lo:104: 00010000:00010000:1.0:1789896054.431847:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431847:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595008 00010000:00010000:3.0:1789896054.431848:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.431853:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595008 00010000:00010000:1.0:1789896054.431863:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896054.431865:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a2685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a268c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431873:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.431875:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896054.431878:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789896054.431879:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00010000:00010000:3.0:1789896054.431884:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431889:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a267e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.431891:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9a00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:0.0:1789896054.431906:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9529ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003594752:12345-0@lo:104: 10000000:00010000:3.0:1789896054.431910:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.431914:0:215462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431919:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896054.431923:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.431927:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896054.431930:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896054.431931:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.431938:0:215462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 23 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.431950:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003594880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896054.431956:0:215462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003595520:0@lo:104: 00010000:00010000:0.0:1789896054.431974:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896054.431979:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9529ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003594752:12345-0@lo:104: Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896054.431984:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789896054.431988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896054.432004:0:215462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896054.432007:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896054.432013:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896054.432027:0:215462:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896054.432032:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595136 00000100:00100000:0.0:1789896054.432036:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595136 00010000:00010000:3.0:1789896054.432037:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432039:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594624 00010000:00010000:3.0:1789896054.432045:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896054.432046:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594624 00000100:00100000:0.0:1789896054.432051:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595520 00000100:00100000:2.0:1789896054.432054:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003593984:0@lo:104: 00000100:00100000:0.0:1789896054.432056:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595520 00010000:00010000:3.0:1789896054.432058:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432067:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.432074:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594112:0@lo:104: 00000100:00100000:0.0:1789896054.432076:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00010000:00010000:3.0:1789896054.432087:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a2669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2670 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.432089:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215462:x1876838003595008:12345-0@lo:104: 00000100:00100000:2.0:1789896054.432093:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594240:0@lo:104: 00010000:00010000:0.0:1789896054.432102:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432111:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003594880 00010000:00010000:3.0:1789896054.432112:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789896054.432115:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594368:0@lo:104: 00010000:00010000:3.0:1789896054.432117:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432117:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003594880 00010000:00010000:3.0:1789896054.432129:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9c00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896054.432133:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.432133:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789896054.432135:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 25 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.432142:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594496:0@lo:104: 00000100:00100000:0.0:1789896054.432144:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:215462:x1876838003595008:12345-0@lo:104: Request processed in 56us (331us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896054.432153:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896054.432160:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.432161:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003594752:0@lo:104: 00000100:00100000:0.0:1789896054.432162:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1789896054.432170:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 10000000:01000000:3.0:1789896054.432174:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896054.432186:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1789896054.432187:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003595008:0@lo:104: 00000100:00100000:1.0:1789896054.432187:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003594624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896054.432190:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432222:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896054.432226:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003595136:12345-0@lo:104: 00010000:00010000:3.0:1789896054.432228:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896054.432230:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 25 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432236:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.432242:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432245:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a265b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2662 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432245:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 25 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432271:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a26a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a26a1 expref: 25 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432282:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896054.432292:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789896054.432300:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215462:x1876838003595136:12345-0@lo:104: Request processed in 102us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896054.432308:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:3.0:1789896054.432310:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789896054.432311:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003595136:0@lo:104: 00000100:00100000:1.0:1789896054.432315:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3615:x1876838003594624:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (713us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896054.432323:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.432324:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789896054.432327:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1789896054.432334:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215462:x1876838003595520:12345-0@lo:104: 00010000:00010000:3.0:1789896054.432336:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8a00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896054.432342:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.432343:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432352:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1789896054.432362:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3616:x1876838003594880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896054.432365:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432370:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:3.0:1789896054.432371:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432377:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896054.432379:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896054.432384:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789896054.432391:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.432397:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215462:x1876838003595520:12345-0@lo:104: Request processed in 63us (395us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896054.432399:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.432403:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003595520:0@lo:104: 00010000:00010000:1.0:1789896054.432407:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a269a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2693 expref: 23 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432417:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896054.432419:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00010000:00010000:3.0:1789896054.432425:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432427:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896054.432433:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a264d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2654 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432441:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896054.432443:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432448:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9000 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896054.432450:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432457:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3616:x1876838003594880:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896054.432472:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00010000:00010000:3.0:1789896054.432475:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896054.432484:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896054.432489:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896054.432507:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432514:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896054.432518:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896054.432519:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432524:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432527:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9000/0x412fd4b3617a263f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2646 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432536:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896054.432540:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432541:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896054.432544:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896054.432547:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432548:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789896054.432554:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.432557:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896054.432562:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789896054.432567:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896054.432572:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003595264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896054.432582:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432587:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896054.432592:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.432600:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896054.432601:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a2631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2638 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432615:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896054.432616:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896054.432619:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896054.432631:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003595904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.432633:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595264 00000100:00100000:1.0:1789896054.432637:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595264 00000100:00100000:3.0:1789896054.432649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896054.432652:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 22 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.432668:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789896054.432675:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003595392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.432676:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595904 00000100:00100000:1.0:1789896054.432679:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595904 00010000:00010000:1.0:1789896054.432690:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a264d expref: 23 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.432695:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1789896054.432702:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896054.432711:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3617:x1876838003595264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896054.432715:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595392 00000100:00100000:1.0:1789896054.432720:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00010000:00010000:0.0:1789896054.432720:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896054.432721:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595392 00000100:00100000:3.0:1789896054.432722:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003596032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896054.432729:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432737:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003595904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896054.432742:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.432746:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 24 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.432749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896054.432751:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896054.432762:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a264d expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.432765:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a268c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2685 expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.432772:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596032 00000100:00100000:2.0:1789896054.432777:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596032 00010000:00010000:0.0:1789896054.432781:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896054.432791:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a264d expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896054.432795:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a263f expref: 24 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432804:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a264d expref: 24 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432815:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896054.432819:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1789896054.432820:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3617:x1876838003595264:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896054.432829:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1789896054.432834:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3617:x1876838003595392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896054.432844:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896054.432849:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3617:x1876838003595904:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (199us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896054.432851:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 22 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.432856:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1789896054.432866:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00010000:00010000:2.0:1789896054.432870:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 22 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.432872:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3617:x1876838003596032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896054.432888:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:0.0:1789896054.432888:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896054.432902:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2e00/0x412fd4b3617a267e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2677 expref: 21 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.432906:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a263f expref: 21 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432918:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963776 00010000:00010000:0.0:1789896054.432924:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a263f expref: 20 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.432925:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963776 00010000:00010000:2.0:1789896054.432936:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896054.432939:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:0.0:1789896054.432942:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a2646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a263f expref: 20 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.432946:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 10 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.432961:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015963904 00000100:00100000:3.0:1789896054.432968:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015963904 00010000:00010000:0.0:1789896054.432971:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896054.432977:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3617:x1876838003595392:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896054.432983:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 556 00010000:00010000:3.0:1789896054.432991:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 11 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.432991:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1789896054.432998:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015963776:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789896054.433003:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3617:x1876838003596032:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896054.433013:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00010000:00010000:1.0:1789896054.433014:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896054.433022:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 11 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896054.433033:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003593728:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896054.433034:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 11 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.433036:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 557 00000100:00100000:3.0:1789896054.433051:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015963904:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896054.433055:0:215462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215462:1876838003593856:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896054.433057:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f64e expref: 11 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433063:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896054.433070:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 11 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.433075:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896054.433079:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 10 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433093:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a26af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f647 expref: 10 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433101:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896054.433114:0:215462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.433118:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015963776:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 124us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896054.433125:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015963904:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896054.433138:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 556 00000100:00100000:3.0:1789896054.433149:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 557 00000100:00100000:1.0:1789896054.433186:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003595648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896054.433194:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003595776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433236:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896054.433249:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896054.433274:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003596160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896054.433278:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896054.433303:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595648 00000100:00100000:0.0:1789896054.433307:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595648 00000100:00100000:3.0:1789896054.433315:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003594880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433316:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896054.433323:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 18 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.433345:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003595776 00000100:00100000:0.0:1789896054.433347:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003595776 00000100:00100000:3.0:1789896054.433354:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596160 00000100:00100000:1.0:1789896054.433355:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003594624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896054.433357:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a265b expref: 19 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.433361:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596160 00000100:00100000:0.0:1789896054.433373:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00010000:00010000:3.0:1789896054.433381:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 20 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.433382:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003595648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433389:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00010000:00010000:0.0:1789896054.433394:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896054.433399:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 20 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.433404:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3616:x1876838003595776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896054.433411:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00010000:00010000:0.0:1789896054.433419:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 20 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.433420:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896054.433423:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003596160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896054.433430:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a265b expref: 20 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433434:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896054.433443:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 20 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.433443:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2669 expref: 20 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.433450:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a265b expref: 20 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433470:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 19 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.433477:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896054.433486:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a265b expref: 19 pid: 188725 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433488:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a2638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2631 expref: 19 pid: 188723 timeout: 4026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433510:0:199629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.433517:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3615:x1876838003595648:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896054.433518:0:199629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896054.433525:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896054.433529:0:199629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896054.433530:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00010000:00010000:3.0:1789896054.433539:0:199629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433554:0:199629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433559:0:199629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433563:0:199629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9200 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:3.0:1789896054.433566:0:199629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.433570:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3616:x1876838003595776:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (291us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896054.433574:0:199629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.433585:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00010000:00010000:3.0:1789896054.433594:0:199629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896054.433604:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896054.433610:0:215462:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896054.433621:0:215462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896054.433627:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003595648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896054.433630:0:215462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a26bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896054.433634:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3615:x1876838003596160:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896054.433646:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003596160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896054.433650:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789896054.433689:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003595776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433717:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003595392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433730:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003596032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433742:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003595264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896054.433751:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003595904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896054.643884:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896054.643956:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896054.643995:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964032 00000100:00100000:3.0:1789896054.644008:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964032 00000100:00100000:1.0:1789896054.644014:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964160 00000100:00100000:1.0:1789896054.644020:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964160 00000100:00080000:2.0:1789896054.644075:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789896054.644080:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789896054.644102:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 529 00000100:00100000:1.0:1789896054.644119:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 530 00000100:00100000:3.0:1789896054.644121:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015964032:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789896054.644135:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015964160:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789896054.644243:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015964160:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896054.644251:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015964032:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896054.644251:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 530 00000100:00100000:3.0:1789896054.644283:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 529 00010000:00010000:3.0:1789896054.764378:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896055.212432:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003596544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896055.212437:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789896055.212461:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003596800:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.212485:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003596928:0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.212529:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896055.212533:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896055.212536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896055.212542:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003596672:0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.212576:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003596288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896055.212578:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003596416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896055.212581:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003597440:0@lo:400:kworker.0 00000100:00100000:3.0:1789896055.212593:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896055.212634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896055.212634:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896055.212635:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003597184:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.212646:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596544 00000100:00100000:1.0:1789896055.212656:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596544 00000100:00100000:2.0:1789896055.212676:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876838003597952:0@lo:400:kworker.0 00000100:00100000:3.0:1789896055.212678:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896055.212678:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003597312:0@lo:400:kworker.0 00000100:00100000:3.0:1789896055.212704:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003597696:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.212711:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896055.212719:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896055.212726:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596288 00000100:00100000:1.0:1789896055.212732:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596288 00000100:00100000:3.0:1789896055.212744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896055.212751:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003597824:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.212754:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596928 00000100:00100000:2.0:1789896055.212759:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596928 00000100:00100000:3.0:1789896055.212769:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003598208:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.212773:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789896055.212790:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003596544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896055.212790:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896055.212798:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597440 00000100:00100000:2.0:1789896055.212803:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597440 00000100:00100000:3.0:1789896055.212812:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789896055.212831:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896055.212835:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789896055.212839:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789896055.212840:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789896055.212849:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003597056:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.212849:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003596928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.212849:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003596288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789896055.212865:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896055.212906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896055.212914:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003596544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896055.212927:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003596928:12345-0@lo:400:kworker.0 Request processed in 79us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.212929:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003596288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896055.212931:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003597568:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.212943:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789896055.212950:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789896055.212959:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896055.212961:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597056 00000100:00100000:0.0:1789896055.212965:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789896055.212966:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597056 00000100:00100000:3.0:1789896055.212974:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003598080:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.212983:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596672 00000100:00100000:1.0:1789896055.212989:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596672 00000100:00100000:2.0:1789896055.212991:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597568 00000100:00100000:3.0:1789896055.212995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896055.212996:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597568 00000100:00100000:0.0:1789896055.213017:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597184 00000100:00100000:2.0:1789896055.213018:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789896055.213024:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597184 00000100:00100000:3.0:1789896055.213030:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596800 00000100:00100000:2.0:1789896055.213031:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003597440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213032:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:3.0:1789896055.213036:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596800 00000100:00100000:1.0:1789896055.213048:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003596672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.213059:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597952 00000100:00100000:0.0:1789896055.213064:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597952 00000100:00100000:2.0:1789896055.213069:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003597440:12345-0@lo:400:kworker.0 Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896055.213073:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597312 00000100:00100000:3.0:1789896055.213078:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597312 00000100:00100000:2.0:1789896055.213090:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789896055.213091:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597696 00000100:00100000:0.0:1789896055.213097:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597696 00000100:00100000:3.0:1789896055.213103:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789896055.213104:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789896055.213113:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003596800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.213113:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003597056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213116:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003596672:12345-0@lo:400:kworker.0 Request processed in 72us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.213119:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003597824 00000100:00100000:0.0:1789896055.213125:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003597824 00000100:00100000:1.0:1789896055.213129:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:0.0:1789896055.213153:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598208 00000100:00100000:3.0:1789896055.213154:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003596800:12345-0@lo:400:kworker.0 Request processed in 45us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896055.213154:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003597056:12345-0@lo:400:kworker.0 Request processed in 43us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.213158:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598208 00000100:00100000:2.0:1789896055.213164:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789896055.213170:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598080 00000100:00100000:3.0:1789896055.213177:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789896055.213177:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598080 00000100:00100000:2.0:1789896055.213182:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789896055.213187:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1789896055.213193:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003597568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896055.213195:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789896055.213226:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003597312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.213231:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003597184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213243:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1789896055.213248:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003597568:12345-0@lo:400:kworker.0 Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896055.213256:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876838003597952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.213257:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789896055.213266:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003597312:12345-0@lo:400:kworker.0 Request processed in 40us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896055.213276:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789896055.213277:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003597184:12345-0@lo:400:kworker.0 Request processed in 78us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.213285:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1789896055.213308:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1789896055.213310:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876838003597952:12345-0@lo:400:kworker.0 Request processed in 57us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896055.213314:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003597440:0@lo:400:kworker.0 00000100:00100000:3.0:1789896055.213316:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1789896055.213321:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003597696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213329:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1789896055.213330:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003597824:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789896055.213335:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa7f095180 x1876838003597952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789896055.213346:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876838003597952:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213351:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1789896055.213360:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003596928:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213364:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003598208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.213370:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003597696:12345-0@lo:400:kworker.0 Request processed in 52us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896055.213376:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003597824:12345-0@lo:400:kworker.0 Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.213383:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1789896055.213389:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1789896055.213405:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1789896055.213412:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003598208:12345-0@lo:400:kworker.0 Request processed in 51us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.213418:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003598080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213424:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1789896055.213431:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003597056:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.213440:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896055.213445:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003597568:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213457:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003596416 00000100:00100000:3.0:1789896055.213461:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003598080:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213464:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003596416 00000100:00100000:0.0:1789896055.213469:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003598080:12345-0@lo:400:kworker.0 Request processed in 54us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896055.213477:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003596672:0@lo:400:kworker.0 00000100:00100000:0.0:1789896055.213478:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789896055.213483:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003596544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896055.213498:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003597184:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213498:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789896055.213507:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003596416:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789896055.213510:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789896055.213515:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003597696:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.213517:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003597312:0@lo:400:kworker.0 00002000:00000024:1.0:1789896055.213524:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789896055.213524:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789896055.213531:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789896055.213532:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa7f096a00 x1876838003598208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789896055.213537:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789896055.213542:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003597824:0@lo:400:kworker.0 00000100:00100000:3.0:1789896055.213545:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003598208:0@lo:400:kworker.0 00000100:00100000:2.0:1789896055.213556:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003596800:0@lo:400:kworker.0 00000100:00100000:1.0:1789896055.213563:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003596416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896055.213574:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003596288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896055.213576:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789896055.213609:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003596416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896055.539812:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896055.539910:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964288 00000100:00100000:1.0:1789896055.539922:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964288 00000100:00100000:1.0:1789896055.539990:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2352 00000100:00100000:1.0:1789896055.540003:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015964288:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896055.540023:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896055.540049:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f655 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896055.540082:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896055.540095:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896055.540106:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6400, rc 0) 00000100:00100000:1.0:1789896055.540171:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015964288:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 170us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896055.540179:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2352 00000100:00100000:2.0:1789896055.541064:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896055.541106:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964416 00000100:00100000:0.0:1789896055.541111:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964416 00000100:00100000:0.0:1789896055.541136:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2353 00000100:00100000:0.0:1789896055.541142:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015964416:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896055.541273:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015964416:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 131us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.541278:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2353 00000100:00100000:0.0:1789896055.541985:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896055.542023:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964544 00000100:00100000:1.0:1789896055.542029:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964544 00000100:00100000:1.0:1789896055.542056:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2354 00000100:00100000:1.0:1789896055.542063:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015964544:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896055.542162:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015964544:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 99us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896055.542170:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2354 00000100:00100000:2.0:1789896055.543247:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896055.543296:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964672 00000100:00100000:0.0:1789896055.543300:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964672 00000100:00100000:0.0:1789896055.543331:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2355 00000100:00100000:0.0:1789896055.543339:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:214563:x1876838015964672:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896055.543433:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:214563:x1876838015964672:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.543441:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2355 00000100:00100000:2.0:1789896055.544097:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896055.544136:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964800 00000100:00100000:1.0:1789896055.544141:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964800 00000100:00100000:1.0:1789896055.544167:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2356 00000100:00100000:1.0:1789896055.544175:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214563:x1876838015964800:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789896055.544255:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214563:x1876838015964800:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896055.544263:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2356 00000100:00100000:3.0:1789896055.545098:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896055.545136:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015964928 00000100:00100000:0.0:1789896055.545140:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015964928 00000100:00100000:0.0:1789896055.545162:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2357 00000100:00100000:0.0:1789896055.545168:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015964928:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896055.545175:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896055.545187:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f65c expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896055.545218:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896055.545232:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896055.545238:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a200, rc 0) 00000100:00100000:0.0:1789896055.545260:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015964928:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896055.545265:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2357 00000100:00100000:2.0:1789896055.545841:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896055.545880:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965056 00000100:00100000:1.0:1789896055.545894:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965056 00000100:00100000:1.0:1789896055.545915:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2358 00000100:00100000:1.0:1789896055.545920:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015965056:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896055.545967:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015965056:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 47us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789896055.545972:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2358 00010000:00010000:3.0:1789896055.788400:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896056.236446:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789896056.236471:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003598336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789896056.236554:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896056.236609:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598336 00000100:00100000:3.0:1789896056.236619:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598336 00000100:00100000:3.0:1789896056.236679:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789896056.236692:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003598336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789896056.236733:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789896056.236794:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003598336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896056.236802:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789896056.236837:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003598336:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1789896056.428337:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896056.428345:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 184 10000000:01000000:1.0:1789896056.428351:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896056.428402:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.428412:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.428420:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896056.428450:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003598464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.428541:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.428583:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94ec5cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.428607:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598464 00000100:00100000:0.0:1789896056.428618:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598464 00000100:00100000:0.0:1789896056.428688:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:0.0:1789896056.428699:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003598464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896056.428714:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896056.428729:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a26d2 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.428757:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.428769:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.428780:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b800, rc 0) 00000100:00100000:0.0:1789896056.428848:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003598464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.428856:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:1.0:1789896056.428863:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003598464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896056.428891:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.428900:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896056.428965:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003598592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.428984:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.429000:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94ec5cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.429017:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598592 00000100:00100000:0.0:1789896056.429022:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598592 00000100:00100000:0.0:1789896056.429046:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:0.0:1789896056.429051:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003598592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.429154:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003598592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.429160:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:1.0:1789896056.429189:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003598592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.429236:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003598720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.429268:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.429284:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94ec5cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.429301:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598720 00000100:00100000:0.0:1789896056.429307:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598720 00000100:00100000:0.0:1789896056.429334:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:0.0:1789896056.429342:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003598720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.429429:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003598720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.429438:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:1.0:1789896056.429448:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003598720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.429796:0:215466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215466:1876838003598848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.429821:0:215466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.429835:0:215466:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94ec5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.429864:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598848 00000100:00100000:0.0:1789896056.429869:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598848 00000100:00100000:0.0:1789896056.429909:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:0.0:1789896056.429920:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215466:x1876838003598848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.429994:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215466:x1876838003598848:12345-0@lo:502:llog_process_th.0 Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.429999:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:1.0:1789896056.430027:0:215466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215466:1876838003598848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.430066:0:215466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215466:1876838003598976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.430096:0:215466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.430119:0:215466:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b0b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.430130:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003598976 00000100:00100000:0.0:1789896056.430134:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003598976 00000100:00100000:0.0:1789896056.430152:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:0.0:1789896056.430161:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215466:x1876838003598976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.430241:0:215466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215466:1876838003598976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.430243:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215466:x1876838003598976:12345-0@lo:502:llog_process_th.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.430255:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000040:00080000:1.0:1789896056.430266:0:215466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789896056.430354:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789896056.430389:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896056.430398:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.430408:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.430417:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789896056.430419:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:2.0:1789896056.430421:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896056.430438:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.430446:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.430453:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.430476:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.430505:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.430528:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.430545:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599104 00000100:00100000:0.0:1789896056.430549:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599104 00000100:00100000:0.0:1789896056.430568:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:0.0:1789896056.430572:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003599104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896056.430578:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896056.430584:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a26e0 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.430595:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.430601:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.430605:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a600, rc 0) 00000100:00100000:0.0:1789896056.430628:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003599104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.430638:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:2.0:1789896056.430659:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896056.430671:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.430680:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.430718:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.430740:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.430755:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.430771:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599232 00000100:00100000:0.0:1789896056.430777:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599232 00000100:00100000:0.0:1789896056.430801:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1789896056.430808:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003599232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.430871:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003599232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.430894:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:2.0:1789896056.430906:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.430935:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.430966:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.430980:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.430996:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599360 00000100:00100000:0.0:1789896056.430999:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599360 00000100:00100000:0.0:1789896056.431016:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:0.0:1789896056.431020:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003599360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.431085:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003599360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.431090:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:2.0:1789896056.431097:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789896056.431784:0:215467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789896056.431851:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789896056.431869:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789896056.431884:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.431891:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896056.431896:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896056.431898:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 184 10000000:01000000:1.0:1789896056.431900:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896056.431914:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.431922:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.431930:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896056.431943:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.431966:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.431990:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b0b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.432015:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599488 00000100:00100000:0.0:1789896056.432020:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599488 00000100:00100000:0.0:1789896056.432046:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:0.0:1789896056.432053:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003599488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896056.432060:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896056.432068:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a26ee expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.432084:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.432093:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.432100:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a400, rc 0) 00000100:00100000:0.0:1789896056.432133:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003599488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.432140:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00100000:1.0:1789896056.432167:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896056.432179:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.432196:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896056.432259:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.432278:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.432294:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b0b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.432317:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599616 00000100:00100000:0.0:1789896056.432328:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599616 00000100:00100000:0.0:1789896056.432364:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:0.0:1789896056.432377:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003599616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.432447:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003599616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.432455:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:1.0:1789896056.432464:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.432485:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.432516:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.432532:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b0b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.432541:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599744 00000100:00100000:0.0:1789896056.432546:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599744 00000100:00100000:0.0:1789896056.432570:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:0.0:1789896056.432577:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003599744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.432654:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003599744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.432663:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003599744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.432664:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00100000:1.0:1789896056.432870:0:215468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215468:1876838003599872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.432913:0:215468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.432932:0:215468:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b0b2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.432956:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003599872 00000100:00100000:0.0:1789896056.432962:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003599872 00000100:00100000:0.0:1789896056.432986:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:0.0:1789896056.432994:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215468:x1876838003599872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.433069:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215468:x1876838003599872:12345-0@lo:502:llog_process_th.0 Request processed in 75us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.433077:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00100000:1.0:1789896056.433085:0:215468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215468:1876838003599872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.433123:0:215468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215468:1876838003600000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.433154:0:215468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.433176:0:215468:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b0b2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.433196:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600000 00000100:00100000:0.0:1789896056.433230:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600000 00000100:00100000:0.0:1789896056.433256:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:0.0:1789896056.433265:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215468:x1876838003600000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.433338:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215468:x1876838003600000:12345-0@lo:502:llog_process_th.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.433340:0:215468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215468:1876838003600000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896056.433358:0:215468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000100:00100000:0.0:1789896056.433363:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000020:01000000:2.0:1789896056.433399:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789896056.433419:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896056.433424:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.433438:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.433443:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789896056.433444:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789896056.433445:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896056.433455:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.433460:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.433465:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.433473:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.433492:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.433515:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.433534:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600128 00000100:00100000:0.0:1789896056.433539:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600128 00000100:00100000:0.0:1789896056.433564:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1789896056.433572:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003600128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896056.433579:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896056.433586:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a26fc expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.433601:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.433619:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.433627:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b000, rc 0) 00000100:00100000:0.0:1789896056.433660:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003600128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.433668:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.433668:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00010000:00010000:2.0:1789896056.433683:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.433692:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.433724:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.433740:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.433757:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.433769:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600256 00000100:00100000:0.0:1789896056.433783:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600256 00000100:00100000:0.0:1789896056.433808:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:0.0:1789896056.433816:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003600256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.433899:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003600256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.433905:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.433910:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:2.0:1789896056.433935:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.433960:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.433971:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.433984:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600384 00000100:00100000:0.0:1789896056.433993:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600384 00000100:00100000:0.0:1789896056.434020:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1789896056.434027:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003600384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.434097:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003600384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.434098:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.434111:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000040:00080000:0.0:1789896056.434701:0:215469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789896056.434752:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789896056.434774:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789896056.434778:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.434783:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.434788:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896056.434790:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 184 10000000:01000000:2.0:1789896056.434791:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896056.434801:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.434805:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.434810:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.434817:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.434840:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.434888:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.434892:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600512 00000100:00100000:1.0:1789896056.434896:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600512 00000100:00100000:1.0:1789896056.434939:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1789896056.434948:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003600512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896056.434954:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896056.434962:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a270a expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.434973:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a270a expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.434979:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a270a expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.434984:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6a00, rc 0) 00000100:00100000:1.0:1789896056.435013:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003600512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.435018:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:2.0:1789896056.435023:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896056.435035:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.435041:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.435076:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.435095:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.435112:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.435126:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600640 00000100:00100000:1.0:1789896056.435131:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600640 00000100:00100000:1.0:1789896056.435160:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1789896056.435170:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003600640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.435262:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003600640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.435268:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:2.0:1789896056.435271:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.435293:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.435317:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.435335:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600768 00000100:00100000:2.0:1789896056.435338:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.435339:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600768 00000100:00100000:1.0:1789896056.435360:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1789896056.435364:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003600768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.435426:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003600768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.435428:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003600768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.435438:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1789896056.435584:0:215470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215470:1876838003600896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.435608:0:215470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.435624:0:215470:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c1066c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.435647:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003600896 00000100:00100000:0.0:1789896056.435652:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003600896 00000100:00100000:0.0:1789896056.435680:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:0.0:1789896056.435686:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215470:x1876838003600896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.435759:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215470:x1876838003600896:12345-0@lo:502:llog_process_th.0 Request processed in 72us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.435767:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:1.0:1789896056.435775:0:215470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215470:1876838003600896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.435813:0:215470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215470:1876838003601024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.435841:0:215470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.435858:0:215470:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.435859:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601024 00000100:00100000:0.0:1789896056.435864:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601024 00000100:00100000:0.0:1789896056.435894:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:0.0:1789896056.435901:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215470:x1876838003601024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.435957:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215470:x1876838003601024:12345-0@lo:502:llog_process_th.0 Request processed in 58us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.435963:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1789896056.435976:0:215470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215470:1876838003601024:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896056.435997:0:215470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789896056.436036:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789896056.436054:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896056.436061:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.436069:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.436077:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789896056.436079:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 209 10000000:01000000:2.0:1789896056.436081:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896056.436101:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.436109:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.436117:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.436129:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.436154:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.436170:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.436186:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601152 00000100:00100000:0.0:1789896056.436192:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601152 00000100:00100000:0.0:1789896056.436244:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1789896056.436252:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003601152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896056.436260:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896056.436272:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2718 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.436287:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.436294:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.436299:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b600, rc 0) 00000100:00100000:0.0:1789896056.436329:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003601152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.436336:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1789896056.436346:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896056.436359:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.436368:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.436400:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.436424:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896056.436448:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601280 00000100:00100000:2.0:1789896056.436450:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.436452:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601280 00000100:00100000:0.0:1789896056.436473:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:0.0:1789896056.436477:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003601280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.436524:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003601280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.436529:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1789896056.436542:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.436563:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.436593:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896056.436607:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601408 00000100:00100000:2.0:1789896056.436608:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.436610:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601408 00000100:00100000:0.0:1789896056.436626:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:0.0:1789896056.436629:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003601408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.436685:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003601408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.436692:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:2.0:1789896056.436697:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.436916:0:215471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215471:1876838003601536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.436945:0:215471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896056.436959:0:215471:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.436979:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601536 00000100:00100000:1.0:1789896056.436984:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601536 00000100:00100000:1.0:1789896056.437010:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:1.0:1789896056.437017:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215471:x1876838003601536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.437097:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215471:x1876838003601536:12345-0@lo:502:llog_process_th.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.437105:0:215471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215471:1876838003601536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.437106:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000020:01000000:0.0:1789896056.437126:0:215471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896056.437136:0:215471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896056.437138:0:215471:0:(obd_config.c:1561:class_process_config()) marker 199 (0x1) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:0.0:1789896056.437142:0:215471:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789896056.437157:0:215471:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:0.0:1789896056.437168:0:215471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215471:1876838003601664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.437191:0:215471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896056.437226:0:215471:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.437235:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601664 00000100:00100000:1.0:1789896056.437240:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601664 00000100:00100000:1.0:1789896056.437263:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:1.0:1789896056.437269:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215471:x1876838003601664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.437331:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215471:x1876838003601664:12345-0@lo:502:llog_process_th.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.437336:0:215471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215471:1876838003601664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.437341:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000020:01000000:0.0:1789896056.437352:0:215471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896056.437356:0:215471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896056.437357:0:215471:0:(obd_config.c:1561:class_process_config()) marker 199 (0x2) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789896056.437360:0:215471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 212 count 208 00000020:01000000:2.0:1789896056.437396:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 209-211 (rc=0) 10000000:01000000:2.0:1789896056.437418:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896056.437424:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.437432:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.437440:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896056.437441:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 184 10000000:01000000:2.0:1789896056.437443:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896056.437456:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.437464:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.437471:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.437481:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.437499:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.437511:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.437531:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601792 00000100:00100000:1.0:1789896056.437536:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601792 00000100:00100000:1.0:1789896056.437564:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:1.0:1789896056.437572:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003601792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896056.437579:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896056.437587:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2726 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.437600:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.437617:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.437624:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6000, rc 0) 00000100:00100000:1.0:1789896056.437656:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003601792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.437663:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:2.0:1789896056.437668:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896056.437677:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.437682:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.437712:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.437729:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.437740:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.437748:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003601920 00000100:00100000:1.0:1789896056.437753:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003601920 00000100:00100000:1.0:1789896056.437776:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:1.0:1789896056.437784:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003601920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.437862:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003601920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.437870:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:2.0:1789896056.437882:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003601920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.437913:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.437944:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.437957:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.437966:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602048 00000100:00100000:1.0:1789896056.437971:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602048 00000100:00100000:1.0:1789896056.437992:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:1.0:1789896056.437997:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003602048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.438054:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003602048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.438058:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.438063:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:1.0:1789896056.438352:0:215472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215472:1876838003602176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.438392:0:215472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.438423:0:215472:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa43720d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.438467:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602176 00000100:00100000:0.0:1789896056.438471:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602176 00000100:00100000:0.0:1789896056.438497:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:0.0:1789896056.438505:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215472:x1876838003602176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.438620:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215472:x1876838003602176:12345-0@lo:502:llog_process_th.0 Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.438627:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00100000:1.0:1789896056.438682:0:215472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215472:1876838003602176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.438715:0:215472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215472:1876838003602304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.438748:0:215472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896056.438772:0:215472:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c1066c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.438792:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602304 00000100:00100000:0.0:1789896056.438798:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602304 00000100:00100000:0.0:1789896056.438825:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1789896056.438833:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215472:x1876838003602304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.438927:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215472:x1876838003602304:12345-0@lo:502:llog_process_th.0 Request processed in 94us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.438936:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1789896056.438942:0:215472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215472:1876838003602304:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896056.438965:0:215472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:2.0:1789896056.439011:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:2.0:1789896056.439028:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896056.439033:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.439039:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.439044:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789896056.439045:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 209 10000000:01000000:2.0:1789896056.439047:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896056.439057:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.439062:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.439066:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.439078:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.439096:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.439109:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.439129:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602432 00000100:00100000:0.0:1789896056.439135:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602432 00000100:00100000:0.0:1789896056.439161:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:0.0:1789896056.439168:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003602432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896056.439176:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896056.439186:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2734 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.439225:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.439234:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896056.439242:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5be00, rc 0) 00000100:00100000:0.0:1789896056.439276:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003602432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.439279:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.439287:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00010000:00010000:2.0:1789896056.439290:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.439297:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.439323:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.439339:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.439356:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.439359:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602560 00000100:00100000:0.0:1789896056.439364:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602560 00000100:00100000:0.0:1789896056.439389:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:0.0:1789896056.439397:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003602560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.439471:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003602560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.439473:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.439492:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.439496:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1789896056.439529:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.439544:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896056.439549:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602688 00000100:00100000:0.0:1789896056.439554:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602688 00000100:00100000:0.0:1789896056.439578:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:0.0:1789896056.439585:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003602688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.439668:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003602688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896056.439670:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003602688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896056.439681:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:0.0:1789896056.440055:0:215473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215473:1876838003602816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896056.440087:0:215473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896056.440105:0:215473:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.440126:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602816 00000100:00100000:1.0:1789896056.440131:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602816 00000100:00100000:1.0:1789896056.440159:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:1.0:1789896056.440167:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215473:x1876838003602816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.440281:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215473:x1876838003602816:12345-0@lo:502:llog_process_th.0 Request processed in 115us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.440290:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:0.0:1789896056.440295:0:215473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215473:1876838003602816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896056.440318:0:215473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896056.440326:0:215473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896056.440328:0:215473:0:(obd_config.c:1561:class_process_config()) marker 198 (0x1) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:0.0:1789896056.440333:0:215473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789896056.440343:0:215473:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000020:01000004:0.0:1789896056.440690:0:215474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789896056.440695:0:215474:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:3.0:1789896056.440700:0:215473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f094000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215473:1876838003602944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896056.440734:0:215473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896056.440759:0:215473:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947c04c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.440771:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003602944 00000100:00100000:1.0:1789896056.440776:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003602944 00000100:00100000:1.0:1789896056.440801:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:1.0:1789896056.440808:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215473:x1876838003602944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896056.440890:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215473:x1876838003602944:12345-0@lo:502:llog_process_th.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896056.440902:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:3.0:1789896056.440929:0:215473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f094000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215473:1876838003602944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896056.440946:0:215473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896056.440950:0:215473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896056.440952:0:215473:0:(obd_config.c:1561:class_process_config()) marker 198 (0x2) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789896056.440955:0:215473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 212 count 208 00000020:01000000:2.0:1789896056.441003:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 209-211 (rc=0) 10000000:01000000:2.0:1789896056.441024:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896056.441030:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.441038:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896056.441051:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896056.441052:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896056.441054:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896056.441068:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.441074:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.441081:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.441091:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003603072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.441115:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.441131:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.441147:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603072 00000100:00100000:1.0:1789896056.441152:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603072 00000100:00100000:1.0:1789896056.441175:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:1.0:1789896056.441184:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003603072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896056.441190:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896056.441228:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2742 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.441246:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.441254:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896056.441261:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7e00, rc 0) 00000100:00100000:1.0:1789896056.441293:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003603072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896056.441299:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003603072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.441302:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00010000:00010000:2.0:1789896056.441310:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.441316:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896056.441341:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003603200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896056.441358:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896056.441376:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952e9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896056.441378:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603200 00000100:00100000:1.0:1789896056.441384:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603200 00000100:00100000:1.0:1789896056.441410:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:1.0:1789896056.441418:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003603200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.441471:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003603200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (110us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896056.441473:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003603200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896056.441485:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 10000000:01000000:2.0:1789896056.441507:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896056.441512:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896056.441517:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896056.812349:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896057.260388:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789896057.260392:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003603456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789896057.260421:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003603328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896057.260479:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896057.260479:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896057.260527:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603328 00000100:00100000:0.0:1789896057.260535:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603328 00000100:00100000:3.0:1789896057.260536:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603456 00000100:00100000:3.0:1789896057.260541:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603456 00000100:00080000:2.0:1789896057.260570:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789896057.260588:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789896057.260590:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789896057.260600:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003603328:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789896057.260607:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003603456:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1789896057.260629:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1789896057.260633:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:0.0:1789896057.260687:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003603328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896057.260696:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003603456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896057.260707:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789896057.260721:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789896057.260733:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003603456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789896057.260733:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003603328:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789896057.836461:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789896058.022539:0:215572:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe4dc0c6a0 20000000:00000080:2.0:1789896058.022553:0:215572:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa7fa3ac00 uarg=0000000000000000 00000040:00100000:2.0:1789896058.023045:0:215572:0:(llog.c:1072:llog_reverse_process()) index 186 : idx 181 20000000:01000000:2.0:1789896058.023051:0:215572:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 185 cmd:0xce022 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:2.0:1789896058.023065:0:215572:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool2 fl=4 20000000:01000000:0.0:1789896058.023360:0:215573:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 168 marker 182 1->4: lustre-clilov new lustre.qpool2 20000000:01000000:0.0:1789896058.023414:0:215573:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 170 marker 182 2->4: lustre-clilov new lustre.qpool2 00000040:00080000:0.0:1789896058.023429:0:215573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000040:00080000:2.0:1789896058.023582:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].187, 224 off42312 20000000:01000000:2.0:1789896058.023600:0:215572:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896058.023617:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].188, 104 off42416 00000040:00080000:2.0:1789896058.023633:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].189, 224 off42640 20000000:01000000:2.0:1789896058.023645:0:215572:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:2.0:1789896058.023950:0:215574:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 194 marker 183 1->4: lustre-MDT0000-mdtlov new lustre.qpool2 20000000:01000000:2.0:1789896058.024049:0:215574:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 196 marker 183 2->4: lustre-MDT0000-mdtlov new lustre.qpool2 00000040:00080000:2.0:1789896058.024075:0:215574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 212 count 208 00000040:00080000:0.0:1789896058.024194:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].212, 224 off47128 20000000:01000000:0.0:1789896058.024231:0:215572:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:0.0:1789896058.024246:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].213, 112 off47240 00000040:00080000:0.0:1789896058.024263:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].214, 224 off47464 20000000:01000000:0.0:1789896058.024276:0:215572:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:2.0:1789896058.024554:0:215575:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 194 marker 184 1->4: lustre-MDT0001-mdtlov new lustre.qpool2 20000000:01000000:2.0:1789896058.024575:0:215575:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 196 marker 184 2->4: lustre-MDT0001-mdtlov new lustre.qpool2 00000040:00080000:2.0:1789896058.024591:0:215575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 212 count 208 00000040:00080000:0.0:1789896058.024683:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].212, 224 off47128 20000000:01000000:0.0:1789896058.024693:0:215572:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:0.0:1789896058.024707:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].213, 112 off47240 00000040:00080000:0.0:1789896058.024721:0:215572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].214, 224 off47464 10000000:01000000:0.0:1789896058.024735:0:215572:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789896058.024761:0:215572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024781:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024790:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024798:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024806:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024813:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024826:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024834:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a270a expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024841:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024848:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024855:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024875:0:215572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024883:0:215572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024918:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.024930:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 23 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.024945:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a46aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003603584:0@lo:104: 00000100:00100000:0.0:1789896058.025016:0:215572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896058.025065:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603584 00000100:00100000:2.0:1789896058.025077:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603584 00010000:00010000:0.0:1789896058.025080:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.025091:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 23 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.025101:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003603712:0@lo:104: 00000100:00100000:0.0:1789896058.025119:0:215572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896058.025125:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1789896058.025138:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215572:x1876838003603584:12345-0@lo:104: 00000100:00100000:3.0:1789896058.025146:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603712 00010000:00010000:0.0:1789896058.025149:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.025152:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025153:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603712 00010000:00010000:0.0:1789896058.025170:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 23 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.025181:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003603840:0@lo:104: 00000100:00100000:3.0:1789896058.025192:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789896058.025222:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215572:x1876838003603712:12345-0@lo:104: 00010000:00010000:3.0:1789896058.025233:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.025235:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789896058.025246:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215572:x1876838003603584:12345-0@lo:104: Request processed in 111us (231us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896058.025246:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789896058.025254:0:215572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896058.025256:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025263:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:1.0:1789896058.025271:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896058.025276:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.025285:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.025286:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603840 00010000:00010000:3.0:1789896058.025288:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896058.025291:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603840 00000100:00100000:3.0:1789896058.025296:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215572:x1876838003603712:12345-0@lo:104: Request processed in 95us (175us total) trans 0 rc 0/0 10000000:00010000:1.0:1789896058.025297:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896058.025303:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896058.025304:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789896058.025323:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1789896058.025331:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215572:x1876838003603840:12345-0@lo:104: 00010000:00010000:0.0:1789896058.025340:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025342:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896058.025342:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025348:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.025359:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896058.025360:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896058.025363:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025370:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896058.025378:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.025383:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896058.025384:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896058.025390:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a2742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2749 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025391:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003603968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896058.025397:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789896058.025400:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.025408:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215572:x1876838003603840:12345-0@lo:104: Request processed in 77us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896058.025410:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896058.025418:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.025420:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00010000:00010000:3.0:1789896058.025422:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896058.025427:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8000 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896058.025431:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025435:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896058.025444:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.025444:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025452:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a273b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896058.025452:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896058.025458:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896058.025463:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025464:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896058.025468:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896058.025471:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.025473:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025480:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896058.025482:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003603968 00010000:00010000:1.0:1789896058.025482:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896058.025488:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003603968 00010000:00010000:1.0:1789896058.025493:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.025497:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 24 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025502:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003604096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896058.025504:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a2726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a272d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.025510:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 24 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.025523:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604224:0@lo:104: 00010000:00010000:1.0:1789896058.025525:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.025528:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.025533:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896058.025535:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896058.025559:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604096 00000100:00100000:2.0:1789896058.025564:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604096 00000100:00100000:0.0:1789896058.025573:0:215572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896058.025576:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00010000:00010000:2.0:1789896058.025580:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 25 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025589:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789896058.025589:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003603968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.025597:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003604352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896058.025601:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896058.025610:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a270a expref: 25 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025614:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00010000:00010000:1.0:1789896058.025614:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 25 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025629:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003604096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.025634:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896058.025635:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a270a expref: 25 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.025642:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896058.025650:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604480:0@lo:104: 00010000:00010000:2.0:1789896058.025652:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 25 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.025652:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 25 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025668:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604352 00000100:00100000:3.0:1789896058.025673:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604352 00010000:00010000:2.0:1789896058.025683:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 26 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025698:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 26 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.025700:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896058.025709:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 26 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.025719:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 26 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025725:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1789896058.025732:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3618:x1876838003603968:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (300us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896058.025733:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896058.025734:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604608:0@lo:104: 00000100:00100000:3.0:1789896058.025736:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3615:x1876838003604352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896058.025744:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00010000:00010000:3.0:1789896058.025750:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896058.025754:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 25 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025765:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 25 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025777:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003604096:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896058.025787:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1789896058.025791:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003604096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896058.025794:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 25 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.025802:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 24 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.025808:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896058.025810:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604736:0@lo:104: 00000100:00100000:2.0:1789896058.025836:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003603968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896058.025841:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025851:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3615:x1876838003604352:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896058.025872:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003604352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896058.025876:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 24 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025877:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1789896058.025888:0:188715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789896058.025893:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604864:0@lo:104: 00000100:00100000:2.0:1789896058.025911:0:188715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896058.025937:0:215572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896058.025967:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.025971:0:188715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896058.025976:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604224 00000100:00100000:1.0:1789896058.025976:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604480 00010000:00010000:0.0:1789896058.025980:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 23 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.025982:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604224 00000100:00100000:1.0:1789896058.025982:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604480 00000100:00100000:0.0:1789896058.025994:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604992:0@lo:104: 00000100:00100000:2.0:1789896058.026000:0:188715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896058.026006:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604864 00000100:00100000:1.0:1789896058.026006:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604608 00000100:00100000:3.0:1789896058.026011:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604864 00000100:00100000:1.0:1789896058.026011:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604608 00000100:00100000:2.0:1789896058.026013:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604736 00000100:00100000:2.0:1789896058.026017:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604736 00000100:00100000:0.0:1789896058.026029:0:215572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896058.026032:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1789896058.026039:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1789896058.026041:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+7:215572:x1876838003604480:12345-0@lo:104: 00000100:00100000:1.0:1789896058.026047:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947143050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+7:215572:x1876838003604224:12345-0@lo:104: 00010000:00010000:3.0:1789896058.026049:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026050:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003604992 00000100:00100000:2.0:1789896058.026054:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003604992 00010000:00010000:1.0:1789896058.026054:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026057:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026070:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00010000:00010000:0.0:1789896058.026078:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 9 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026084:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+8:215572:x1876838003604608:12345-0@lo:104: 00000100:00100000:0.0:1789896058.026091:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003605120:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896058.026094:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896058.026095:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026100:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896058.026104:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+8:215572:x1876838003604480:12345-0@lo:104: Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896058.026107:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947143050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+8:215572:x1876838003604224:12345-0@lo:104: Request processed in 61us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896058.026114:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1789896058.026117:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1789896058.026128:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789896058.026136:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+6:215572:x1876838003604864:12345-0@lo:104: 00010000:00010000:0.0:1789896058.026143:0:215572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026144:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.026154:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789896058.026158:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00010000:00010000:0.0:1789896058.026158:0:215572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 9 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026167:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+6:215572:x1876838003604608:12345-0@lo:104: Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896058.026171:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+6:215572:x1876838003604736:12345-0@lo:104: 00000100:00100000:0.0:1789896058.026172:0:215572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003605248:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789896058.026184:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:1.0:1789896058.026186:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026187:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789896058.026195:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+6:215572:x1876838003604864:12345-0@lo:104: Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896058.026224:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789896058.026230:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1789896058.026241:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215572:x1876838003604992:12345-0@lo:104: 00010000:00010000:3.0:1789896058.026244:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789896058.026249:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.026254:0:215572:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15780 going to sleep for 11 seconds 00010000:00010000:1.0:1789896058.026257:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1789896058.026258:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.026264:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:215572:x1876838003604736:12345-0@lo:104: Request processed in 96us (263us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896058.026266:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896058.026272:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026274:0:215572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7e00/0x412fd4b3617a2749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2742 expref: 23 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.026278:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00010000:00010000:3.0:1789896058.026294:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026298:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789896058.026298:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a46aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003603584:0@lo:104: 00010000:00010000:1.0:1789896058.026305:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896058.026308:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026313:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9800 already unused, calling callback (ffffffffc1214c20) 10000000:01000000:3.0:1789896058.026314:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789896058.026316:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026318:0:215572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a273b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2734 expref: 22 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.026319:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1789896058.026334:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026334:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:215572:x1876838003604992:12345-0@lo:104: Request processed in 93us (304us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896058.026336:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.026341:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a468a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003603712:0@lo:104: 00010000:00010000:3.0:1789896058.026352:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896058.026352:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 10000000:00010000:1.0:1789896058.026353:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026362:0:215572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a272d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2726 expref: 21 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896058.026363:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896058.026368:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026380:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026383:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a270a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2711 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026387:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896058.026387:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003603840:0@lo:104: 00010000:00010000:3.0:1789896058.026397:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789896058.026397:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026401:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026404:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a271f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.026405:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604224:0@lo:104: 00010000:00010000:3.0:1789896058.026409:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896058.026414:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.026420:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604480:0@lo:104: 00010000:00010000:3.0:1789896058.026434:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026434:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789896058.026435:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604608:0@lo:104: 00010000:00010000:1.0:1789896058.026438:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896058.026447:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026448:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896058.026451:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896058.026453:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896058.026453:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604736:0@lo:104: 00010000:00010000:1.0:1789896058.026462:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026468:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.026469:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604864:0@lo:104: 10000000:00010000:1.0:1789896058.026470:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026479:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1789896058.026480:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896058.026487:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003604992:0@lo:104: 00010000:00010000:1.0:1789896058.026493:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026499:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026500:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896058.026506:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a26fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2703 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026506:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026513:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a26e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26e7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026513:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896058.026518:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896058.026520:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026522:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003605632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896058.026524:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026526:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.026530:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.026533:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896058.026537:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896058.026540:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026548:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896058.026554:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026560:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896058.026569:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026571:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.026584:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003605632 00000100:00100000:2.0:1789896058.026588:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:0.0:1789896058.026588:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896058.026589:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.026595:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003605632 00000100:00100000:2.0:1789896058.026600:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003605760:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789896058.026606:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789896058.026612:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896058.026612:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 21 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026626:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026631:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896058.026632:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.026635:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00010000:00010000:0.0:1789896058.026638:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026643:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896058.026647:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896058.026649:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003605632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896058.026656:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026657:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a26ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26f5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026660:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896058.026669:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 21 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.026671:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6e00/0x412fd4b3617a26d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a26d9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026676:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003605760 00010000:00010000:0.0:1789896058.026678:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896058.026682:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896058.026683:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003605760 00010000:00010000:1.0:1789896058.026683:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 21 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026684:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896058.026689:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896058.026692:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896058.026694:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.026696:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a26fc expref: 22 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.026703:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 22 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026707:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896058.026715:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003605376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896058.026730:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1789896058.026741:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003605760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.026743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896058.026743:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003605632:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896058.026754:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00010000:00010000:2.0:1789896058.026756:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896058.026762:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 20 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.026765:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003605888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896058.026767:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003605376 00000100:00100000:1.0:1789896058.026771:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003605376 00010000:00010000:2.0:1789896058.026780:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 21 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026786:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a270a expref: 21 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.026792:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896058.026798:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a600/0x412fd4b3617a26e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a26e0 expref: 21 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.026804:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003605888 00000100:00100000:1.0:1789896058.026809:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003605888 00010000:00010000:2.0:1789896058.026813:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896058.026815:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:0.0:1789896058.026817:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896058.026820:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 21 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896058.026822:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003605504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896058.026824:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896058.026837:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1789896058.026853:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003605376:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896058.026853:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1789896058.026854:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896058.026869:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003605760:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896058.026880:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003605888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896058.026882:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896058.026886:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00010000:00010000:1.0:1789896058.026892:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a270a expref: 21 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026895:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896058.026904:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 20 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026905:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a270a expref: 20 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026927:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 20 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.026934:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003605760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.026943:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003606016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896058.026948:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003605632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896058.026953:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a270a expref: 20 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.026958:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a26f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a26ee expref: 20 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.026969:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896058.026970:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896058.026972:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896058.026993:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003605504 00000100:00100000:1.0:1789896058.026996:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003605376:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896058.026997:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003605504 00000100:00100000:1.0:1789896058.027003:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1789896058.027012:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003605888:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (219us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896058.027013:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 18 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896058.027015:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606016 00000100:00100000:1.0:1789896058.027018:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606016 00010000:00010000:1.0:1789896058.027027:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 19 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.027030:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1789896058.027047:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1789896058.027055:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1789896058.027055:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003606016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.027061:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003605504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896058.027062:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896058.027066:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 18 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.027068:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896058.027072:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 18 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.027076:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 18 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.027085:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 18 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.027094:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a26d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a26d2 expref: 18 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.027095:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a271f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2718 expref: 18 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896058.027103:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896058.027105:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896058.027125:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3617:x1876838003605504:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896058.027125:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3617:x1876838003606016:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896058.027131:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1789896058.027133:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1789896058.027154:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003605504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.027162:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003606016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.027168:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003605376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896058.027174:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003605888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896058.027983:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003605120:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789896058.027993:0:215572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215572:1876838003605248:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896058.028024:0:215572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.028089:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896058.028120:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896058.028123:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965312 00000100:00100000:2.0:1789896058.028128:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965312 00010000:00010000:2.0:1789896058.028146:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 10 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.028160:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965184 00000100:00100000:2.0:1789896058.028162:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965184 00010000:00010000:2.0:1789896058.028171:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 11 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.028172:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 570 00000100:00100000:0.0:1789896058.028187:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015965312:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896058.028195:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 571 00000100:00100000:2.0:1789896058.028221:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015965184:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789896058.028226:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896058.028230:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896058.028235:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 11 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.028239:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 11 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028251:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 11 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.028268:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 11 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028285:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a26cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f65c expref: 11 pid: 188726 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.028291:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a26c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f655 expref: 11 pid: 188723 timeout: 4030 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028307:0:199629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028326:0:199629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896058.028334:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896058.028340:0:199629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028350:0:199629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028357:0:199629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028364:0:199629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028370:0:199629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a000 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:0.0:1789896058.028376:0:199629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.028378:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015965184:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 157us (256us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896058.028389:0:199629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896058.028396:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 571 00010000:00010000:0.0:1789896058.028410:0:199629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896058.028419:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896058.028438:0:215572:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.028444:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+8:2403:x1876838015965312:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 260us (354us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896058.028452:0:215572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896058.028456:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 570 00010000:00010000:1.0:1789896058.028463:0:215572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2750 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896058.861456:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896059.571735:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.571883:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965440 00000100:00100000:1.0:1789896059.571893:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965440 00000100:00100000:1.0:1789896059.571948:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2397 00000100:00100000:1.0:1789896059.571957:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015965440:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.571973:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896059.571994:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f663 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.572021:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.572031:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.572050:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6a00, rc 0) 00000100:00100000:1.0:1789896059.572108:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015965440:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 152us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.572113:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2397 00000100:00100000:2.0:1789896059.573215:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.573265:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965568 00000100:00100000:1.0:1789896059.573271:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965568 00000100:00100000:1.0:1789896059.573301:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2398 00000100:00100000:1.0:1789896059.573310:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015965568:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.573431:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015965568:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 122us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.573438:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2398 00000100:00100000:3.0:1789896059.574305:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.574365:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965696 00000100:00100000:1.0:1789896059.574375:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965696 00000100:00100000:1.0:1789896059.574420:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2399 00000100:00100000:1.0:1789896059.574431:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015965696:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.574569:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015965696:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 141us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.574575:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2399 00000100:00100000:0.0:1789896059.575920:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.575979:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965824 00000100:00100000:1.0:1789896059.575984:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965824 00000100:00100000:1.0:1789896059.576029:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2400 00000100:00100000:1.0:1789896059.576039:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214581:x1876838015965824:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789896059.576146:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:214581:x1876838015965824:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.576161:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2400 00000100:00100000:2.0:1789896059.577074:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.577115:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015965952 00000100:00100000:1.0:1789896059.577120:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015965952 00000100:00100000:1.0:1789896059.577144:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2401 00000100:00100000:1.0:1789896059.577153:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:214581:x1876838015965952:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789896059.577248:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:214581:x1876838015965952:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 98us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.577254:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2401 00000100:00100000:3.0:1789896059.578420:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.578508:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966080 00000100:00100000:1.0:1789896059.578517:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966080 00000100:00100000:1.0:1789896059.578578:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2402 00000100:00100000:1.0:1789896059.578586:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015966080:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.578601:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896059.578619:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f66a expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.578641:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.578650:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.578658:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6400, rc 0) 00000100:00100000:1.0:1789896059.578708:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015966080:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 123us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.578713:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2402 00000100:00100000:0.0:1789896059.579749:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896059.579801:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966208 00000100:00100000:1.0:1789896059.579808:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966208 00000100:00100000:1.0:1789896059.579836:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2403 00000100:00100000:1.0:1789896059.579852:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015966208:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.579942:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015966208:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 99us (195us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789896059.579950:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2403 00000100:00100000:3.0:1789896059.763485:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896059.763518:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896059.763547:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966464 00000100:00100000:2.0:1789896059.763559:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966464 00000100:00100000:0.0:1789896059.763597:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966336 00000100:00100000:0.0:1789896059.763604:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966336 00000100:00080000:3.0:1789896059.763611:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789896059.763616:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896059.763635:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 537 00000100:00100000:2.0:1789896059.763646:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015966464:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896059.763652:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 538 00000100:00100000:0.0:1789896059.763666:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015966336:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896059.763717:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015966464:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.763718:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015966336:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 57us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.763732:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 537 00000100:00100000:0.0:1789896059.763738:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 538 10000000:01000000:1.0:1789896059.820333:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896059.820341:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 187 10000000:01000000:1.0:1789896059.820347:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896059.820393:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.820404:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.820416:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.820447:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.820520:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.820560:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.820636:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606144 00000100:00100000:2.0:1789896059.820645:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606144 00000100:00100000:2.0:1789896059.820699:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1789896059.820710:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003606144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896059.820724:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896059.820740:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2765 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.820770:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.820787:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.820797:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9a00, rc 0) 00000100:00100000:2.0:1789896059.820853:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003606144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.820868:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1789896059.820880:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.820896:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.820919:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.820992:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.821021:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.821041:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.821053:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606272 00000100:00100000:0.0:1789896059.821058:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606272 00000100:00100000:0.0:1789896059.821088:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:0.0:1789896059.821097:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003606272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.821229:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003606272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.821235:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1789896059.821245:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.821278:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.821315:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.821338:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.821351:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606400 00000100:00100000:2.0:1789896059.821356:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606400 00000100:00100000:2.0:1789896059.821380:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:2.0:1789896059.821387:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003606400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.821472:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003606400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.821481:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1789896059.821488:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.821736:0:215577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215577:1876838003606528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.821765:0:215577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.821781:0:215577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.821803:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606528 00000100:00100000:0.0:1789896059.821808:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606528 00000100:00100000:0.0:1789896059.821836:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1789896059.821850:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215577:x1876838003606528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.821932:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215577:x1876838003606528:12345-0@lo:502:llog_process_th.0 Request processed in 83us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.821938:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1789896059.821947:0:215577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215577:1876838003606528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.821984:0:215577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215577:1876838003606656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.822026:0:215577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.822040:0:215577:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25480 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.822067:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606656 00000100:00100000:2.0:1789896059.822072:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606656 00000100:00100000:2.0:1789896059.822094:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1789896059.822101:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215577:x1876838003606656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.822160:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:215577:x1876838003606656:12345-0@lo:502:llog_process_th.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.822165:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:1.0:1789896059.822172:0:215577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215577:1876838003606656:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896059.822194:0:215577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:0.0:1789896059.822284:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:0.0:1789896059.822305:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896059.822313:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.822328:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896059.822337:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789896059.822339:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789896059.822342:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896059.822357:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.822364:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.822372:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.822386:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.822413:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.822439:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c2769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.822445:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606784 00000100:00100000:1.0:1789896059.822450:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606784 00000100:00100000:1.0:1789896059.822475:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:1.0:1789896059.822482:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003606784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.822489:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896059.822502:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2773 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.822518:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 17 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.822527:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 17 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.822534:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6000, rc 0) 00000100:00100000:1.0:1789896059.822562:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003606784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.822569:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:0.0:1789896059.822587:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.822597:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.822602:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.822630:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.822647:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.822669:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c2769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.822703:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003606912 00000100:00100000:2.0:1789896059.822708:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003606912 00000100:00100000:2.0:1789896059.822741:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:2.0:1789896059.822749:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003606912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.822830:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003606912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.822837:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00100000:0.0:1789896059.822852:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003606912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.822889:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.822923:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.822942:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c2769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.822961:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607040 00000100:00100000:1.0:1789896059.822965:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607040 00000100:00100000:1.0:1789896059.822991:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:1.0:1789896059.822998:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003607040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.823071:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003607040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.823079:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:0.0:1789896059.823085:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896059.823781:0:215578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789896059.823867:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789896059.823889:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789896059.823895:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.823903:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896059.823910:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896059.823917:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 187 10000000:01000000:1.0:1789896059.823920:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896059.823933:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.823939:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.823945:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.823956:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.823979:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.824002:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.824012:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607168 00000100:00100000:2.0:1789896059.824016:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607168 00000100:00100000:2.0:1789896059.824037:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:2.0:1789896059.824041:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003607168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896059.824052:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896059.824059:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2781 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.824069:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.824075:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.824080:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8200, rc 0) 00000100:00100000:2.0:1789896059.824107:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003607168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.824115:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00100000:1.0:1789896059.824123:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.824136:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.824143:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.824179:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.824221:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.824248:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607296 00000100:00100000:1.0:1789896059.824251:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.824254:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607296 00000100:00100000:0.0:1789896059.824282:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:0.0:1789896059.824290:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003607296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.824354:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003607296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.824361:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1789896059.824367:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.824394:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.824427:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.824453:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.824479:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607424 00000100:00100000:2.0:1789896059.824483:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607424 00000100:00100000:2.0:1789896059.824503:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:2.0:1789896059.824508:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003607424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.824567:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003607424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.824574:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:1.0:1789896059.824580:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.824816:0:215579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215579:1876838003607552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.824865:0:215579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.824882:0:215579:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.824900:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607552 00000100:00100000:0.0:1789896059.824905:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607552 00000100:00100000:0.0:1789896059.824928:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:0.0:1789896059.824935:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215579:x1876838003607552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.825000:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215579:x1876838003607552:12345-0@lo:502:llog_process_th.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.825006:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1789896059.825018:0:215579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215579:1876838003607552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.825058:0:215579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215579:1876838003607680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.825090:0:215579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.825108:0:215579:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.825122:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607680 00000100:00100000:2.0:1789896059.825126:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607680 00000100:00100000:2.0:1789896059.825146:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:2.0:1789896059.825150:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215579:x1876838003607680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.825215:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:215579:x1876838003607680:12345-0@lo:502:llog_process_th.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.825227:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:1.0:1789896059.825234:0:215579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215579:1876838003607680:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896059.825258:0:215579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:0.0:1789896059.825301:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:0.0:1789896059.825323:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896059.825330:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.825350:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896059.825357:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789896059.825358:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:0.0:1789896059.825361:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896059.825375:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.825382:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.825389:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.825401:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.825427:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.825454:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607808 00000100:00100000:0.0:1789896059.825458:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.825459:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607808 00000100:00100000:1.0:1789896059.825492:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:1.0:1789896059.825499:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003607808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.825506:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896059.825514:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a278f expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.825528:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a278f expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.825537:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a278f expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.825545:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6600, rc 0) 00000100:00100000:1.0:1789896059.825585:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003607808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.825592:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1789896059.825597:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.825609:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.825618:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.825651:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.825668:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.825686:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.825703:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003607936 00000100:00100000:2.0:1789896059.825708:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003607936 00000100:00100000:2.0:1789896059.825730:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:2.0:1789896059.825737:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003607936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.825803:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003607936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.825809:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:0.0:1789896059.825818:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003607936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.825860:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.825889:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.825900:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.825922:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608064 00000100:00100000:1.0:1789896059.825927:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608064 00000100:00100000:1.0:1789896059.825953:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1789896059.825961:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003608064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.826034:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003608064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.826037:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.826047:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000040:00080000:1.0:1789896059.826753:0:215580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789896059.826817:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789896059.826857:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789896059.826863:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.826877:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896059.826885:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896059.826887:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 187 10000000:01000000:0.0:1789896059.826890:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896059.826905:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.826912:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.826919:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.826932:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.826959:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.826999:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.827000:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608192 00000100:00100000:2.0:1789896059.827005:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608192 00000100:00100000:2.0:1789896059.827025:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1789896059.827029:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003608192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896059.827035:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896059.827041:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a279d expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.827052:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a279d expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.827058:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a279d expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.827063:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9c00, rc 0) 00000100:00100000:2.0:1789896059.827086:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003608192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.827090:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:0.0:1789896059.827102:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.827122:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.827130:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.827164:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.827183:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.827222:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.827236:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608320 00000100:00100000:1.0:1789896059.827241:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608320 00000100:00100000:1.0:1789896059.827267:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1789896059.827275:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003608320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.827346:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003608320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.827354:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:0.0:1789896059.827358:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.827386:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.827415:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.827438:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.827455:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608448 00000100:00100000:2.0:1789896059.827472:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608448 00000100:00100000:2.0:1789896059.827505:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1789896059.827513:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003608448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.827582:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003608448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.827589:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:0.0:1789896059.827594:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.827802:0:215581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215581:1876838003608576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.827835:0:215581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.827865:0:215581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.827876:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608576 00000100:00100000:1.0:1789896059.827882:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608576 00000100:00100000:1.0:1789896059.827906:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1789896059.827913:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215581:x1876838003608576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.827984:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215581:x1876838003608576:12345-0@lo:502:llog_process_th.0 Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.827991:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:0.0:1789896059.827997:0:215581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215581:1876838003608576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.828035:0:215581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215581:1876838003608704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.828067:0:215581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.828085:0:215581:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.828100:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608704 00000100:00100000:2.0:1789896059.828104:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608704 00000100:00100000:2.0:1789896059.828122:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:2.0:1789896059.828126:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215581:x1876838003608704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.828175:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:215581:x1876838003608704:12345-0@lo:502:llog_process_th.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.828181:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:0.0:1789896059.828189:0:215581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215581:1876838003608704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896059.828241:0:215581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:1.0:1789896059.828284:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:1.0:1789896059.828315:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896059.828321:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.828330:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896059.828338:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789896059.828339:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 212 10000000:01000000:1.0:1789896059.828341:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896059.828354:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.828361:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.828369:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.828380:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.828403:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.828429:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608832 00000100:00100000:1.0:1789896059.828431:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.828435:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608832 00000100:00100000:0.0:1789896059.828464:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:0.0:1789896059.828472:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003608832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.828479:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896059.828487:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a27ab expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.828500:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.828508:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.828515:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a800, rc 0) 00000100:00100000:0.0:1789896059.828546:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003608832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.828555:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.828555:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00010000:00010000:1.0:1789896059.828571:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.828579:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.828614:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.828640:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.828657:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.828689:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003608960 00000100:00100000:2.0:1789896059.828694:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003608960 00000100:00100000:2.0:1789896059.828721:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:2.0:1789896059.828729:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003608960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.828796:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003608960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.828801:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003608960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.828808:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:1.0:1789896059.828825:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.828869:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.828886:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.828912:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609088 00000100:00100000:0.0:1789896059.828917:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609088 00000100:00100000:0.0:1789896059.828943:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:0.0:1789896059.828950:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003609088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.829027:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003609088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.829033:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.829037:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:1.0:1789896059.829249:0:215582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215582:1876838003609216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.829277:0:215582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.829297:0:215582:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.829312:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609216 00000100:00100000:2.0:1789896059.829316:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609216 00000100:00100000:2.0:1789896059.829334:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1789896059.829339:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215582:x1876838003609216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.829421:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215582:x1876838003609216:12345-0@lo:502:llog_process_th.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.829428:0:215582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215582:1876838003609216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.829440:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000020:01000000:1.0:1789896059.829453:0:215582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896059.829463:0:215582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896059.829466:0:215582:0:(obd_config.c:1561:class_process_config()) marker 202 (0x1) lustre-MDT0001-m del lustre.qpool2 00000020:00000080:1.0:1789896059.829471:0:215582:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1789896059.829537:0:215582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215582:1876838003609344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.829565:0:215582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.829580:0:215582:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.829597:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609344 00000100:00100000:0.0:1789896059.829607:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609344 00000100:00100000:0.0:1789896059.829633:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:0.0:1789896059.829639:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215582:x1876838003609344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.829708:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:215582:x1876838003609344:12345-0@lo:502:llog_process_th.0 Request processed in 68us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.829712:0:215582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215582:1876838003609344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.829718:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000020:01000000:1.0:1789896059.829735:0:215582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896059.829741:0:215582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896059.829743:0:215582:0:(obd_config.c:1561:class_process_config()) marker 202 (0x2) lustre-MDT0001-m del lustre.qpool2 00000040:00080000:1.0:1789896059.829747:0:215582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 215 count 211 00000020:01000000:0.0:1789896059.829784:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 212-214 (rc=0) 10000000:01000000:0.0:1789896059.829807:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789896059.829813:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.829822:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896059.829829:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896059.829831:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 187 10000000:01000000:0.0:1789896059.829833:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896059.829859:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.829867:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.829873:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.829885:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.829908:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.829926:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.829944:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609472 00000100:00100000:2.0:1789896059.829948:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609472 00000100:00100000:2.0:1789896059.829968:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430 00000100:00100000:2.0:1789896059.829973:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003609472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896059.829978:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896059.829984:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a27b9 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.829994:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.830000:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.830007:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896059.830041:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003609472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.830048:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430 00000100:00100000:0.0:1789896059.830069:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.830079:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.830085:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.830122:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.830147:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.830165:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.830175:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609600 00000100:00100000:1.0:1789896059.830180:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609600 00000100:00100000:1.0:1789896059.830226:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:1.0:1789896059.830233:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003609600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.830292:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003609600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.830301:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:0.0:1789896059.830308:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.830338:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.830370:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.830397:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.830406:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609728 00000100:00100000:2.0:1789896059.830410:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609728 00000100:00100000:2.0:1789896059.830429:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:2.0:1789896059.830434:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003609728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.830482:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003609728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.830488:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:0.0:1789896059.830491:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003609728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.830695:0:215583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215583:1876838003609856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.830718:0:215583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.830731:0:215583:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.830737:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609856 00000100:00100000:1.0:1789896059.830742:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609856 00000100:00100000:1.0:1789896059.830765:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1789896059.830773:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215583:x1876838003609856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.830851:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215583:x1876838003609856:12345-0@lo:502:llog_process_th.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.830856:0:215583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215583:1876838003609856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.830863:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:0.0:1789896059.830887:0:215583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215583:1876838003609984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.830912:0:215583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.830924:0:215583:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa44d5d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.830979:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003609984 00000100:00100000:2.0:1789896059.830989:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003609984 00000100:00100000:2.0:1789896059.831015:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:2.0:1789896059.831024:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215583:x1876838003609984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.831089:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:215583:x1876838003609984:12345-0@lo:502:llog_process_th.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.831093:0:215583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215583:1876838003609984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.831102:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000040:00080000:0.0:1789896059.831113:0:215583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:1.0:1789896059.831166:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:1.0:1789896059.831184:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896059.831189:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.831216:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896059.831224:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789896059.831226:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 212 10000000:01000000:1.0:1789896059.831228:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896059.831242:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.831250:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.831268:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.831285:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.831314:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.831334:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610112 00000100:00100000:0.0:1789896059.831338:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610112 00000100:00100000:1.0:1789896059.831339:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.831359:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:0.0:1789896059.831365:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003610112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.831370:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896059.831376:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a27c7 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.831385:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.831390:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.831395:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ae00, rc 0) 00000100:00100000:0.0:1789896059.831419:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003610112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.831424:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00100000:1.0:1789896059.831431:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896059.831443:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896059.831452:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896059.831484:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.831507:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.831522:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.831543:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610240 00000100:00100000:2.0:1789896059.831548:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610240 00000100:00100000:2.0:1789896059.831573:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436 00000100:00100000:2.0:1789896059.831580:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003610240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896059.831639:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003610240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.831644:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436 00000100:00100000:1.0:1789896059.831651:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.831676:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.831705:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.831719:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.831732:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610368 00000100:00100000:0.0:1789896059.831735:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610368 00000100:00100000:0.0:1789896059.831754:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:0.0:1789896059.831759:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003610368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.831810:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003610368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896059.831815:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:1.0:1789896059.831819:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.832032:0:215584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215584:1876838003610496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.832062:0:215584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.832083:0:215584:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.832114:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610496 00000100:00100000:2.0:1789896059.832120:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610496 00000100:00100000:2.0:1789896059.832141:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:2.0:1789896059.832146:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215584:x1876838003610496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896059.832244:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215584:x1876838003610496:12345-0@lo:502:llog_process_th.0 Request processed in 95us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.832250:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1789896059.832254:0:215584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215584:1876838003610496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896059.832277:0:215584:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896059.832284:0:215584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896059.832286:0:215584:0:(obd_config.c:1561:class_process_config()) marker 201 (0x1) lustre-MDT0000-m del lustre.qpool2 00000020:00000080:1.0:1789896059.832290:0:215584:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1789896059.832837:0:215584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215584:1876838003610624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896059.832881:0:215584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896059.832902:0:215584:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789896059.832920:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610624 00000100:00100000:0.0:1789896059.832925:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610624 00000100:00100000:0.0:1789896059.832952:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:0.0:1789896059.832959:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215584:x1876838003610624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.833043:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:215584:x1876838003610624:12345-0@lo:502:llog_process_th.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896059.833050:0:215584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:215584:1876838003610624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896059.833053:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000020:01000000:1.0:1789896059.833073:0:215584:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896059.833078:0:215584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896059.833080:0:215584:0:(obd_config.c:1561:class_process_config()) marker 201 (0x2) lustre-MDT0000-m del lustre.qpool2 00000040:00080000:1.0:1789896059.833084:0:215584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 215 count 211 00000020:01000000:0.0:1789896059.833121:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 212-214 (rc=0) 10000000:01000000:0.0:1789896059.833142:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789896059.833149:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.833157:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896059.833165:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789896059.833167:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:0.0:1789896059.833169:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789896059.833183:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.833190:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.833223:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.833238:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.833263:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.833285:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896059.833301:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610752 00000100:00100000:2.0:1789896059.833307:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610752 00000100:00100000:2.0:1789896059.833344:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:2.0:1789896059.833353:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003610752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896059.833361:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896059.833370:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a27d5 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.833392:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.833401:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896059.833409:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896059.833444:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003610752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896059.833450:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:0.0:1789896059.833472:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896059.833482:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.833493:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896059.833519:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896059.833538:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896059.833556:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896059.833557:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003610880 00000100:00100000:1.0:1789896059.833563:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003610880 00000100:00100000:1.0:1789896059.833589:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441 00000100:00100000:1.0:1789896059.833596:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003610880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.833645:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003610880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 49us (105us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896059.833651:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003610880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896059.833655:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441 10000000:01000000:0.0:1789896059.833677:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789896059.833681:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.833686:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896059.884383:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896060.332470:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003611136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896060.332484:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003611008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896060.332584:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896060.332640:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896060.332646:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611008 00000100:00100000:1.0:1789896060.332655:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611008 00000100:00100000:2.0:1789896060.332708:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611136 00000100:00080000:3.0:1789896060.332712:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789896060.332719:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611136 00000100:00100000:1.0:1789896060.332759:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1789896060.332779:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789896060.332781:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003611008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896060.332799:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789896060.332814:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003611136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789896060.332822:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789896060.332854:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896060.332917:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003611008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896060.332926:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003611136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896060.332956:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789896060.332966:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789896060.332973:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003611136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896060.333069:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003611008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896060.333329:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003611392:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.333348:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003611264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896060.333375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896060.333410:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789896060.333411:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896060.333424:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003611776:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.333456:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789896060.333470:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896060.333471:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003611904:0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.333498:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789896060.333513:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003612416:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.333524:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896060.333557:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003611520:0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.333570:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896060.333590:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611904 00000100:00100000:1.0:1789896060.333596:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611904 00000100:00100000:3.0:1789896060.333609:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003612288:0@lo:400:kworker.0 00000100:00100000:2.0:1789896060.333618:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896060.333664:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003612032:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.333665:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611520 00000100:00100000:3.0:1789896060.333674:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896060.333674:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611520 00000100:00100000:1.0:1789896060.333730:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789896060.333736:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896060.333744:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611392 00000100:00100000:1.0:1789896060.333746:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003611904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.333752:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611392 00000100:00100000:2.0:1789896060.333806:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876838003612544:0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.333810:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611776 00000100:00100000:3.0:1789896060.333816:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611776 00000100:00100000:1.0:1789896060.333828:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003611904:12345-0@lo:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896060.333848:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789896060.333872:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789896060.333887:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789896060.333888:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896060.333900:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003611392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.333905:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003611520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896060.333938:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789896060.333952:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003611648:0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.333977:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003611392:12345-0@lo:400:kworker.0 Request processed in 86us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896060.333978:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003611520:12345-0@lo:400:kworker.0 Request processed in 73us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896060.333993:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789896060.333993:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789896060.334004:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896060.334035:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789896060.334041:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612416 00000100:00100000:2.0:1789896060.334047:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003612160:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334050:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612416 00000100:00100000:3.0:1789896060.334060:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003611776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334096:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612288 00000100:00100000:1.0:1789896060.334100:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612288 00000100:00100000:2.0:1789896060.334107:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896060.334132:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612032 00000100:00100000:3.0:1789896060.334136:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003611776:12345-0@lo:400:kworker.0 Request processed in 77us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896060.334139:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612032 00000100:00100000:3.0:1789896060.334147:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789896060.334162:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1789896060.334169:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003611520:0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.334186:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612544 00000100:00100000:1.0:1789896060.334193:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003612416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.334194:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612544 00000100:00100000:3.0:1789896060.334256:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611648 00000100:00100000:3.0:1789896060.334261:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611648 00000100:00100000:2.0:1789896060.334280:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612160 00000100:00100000:1.0:1789896060.334290:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003612416:12345-0@lo:400:kworker.0 Request processed in 103us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896060.334291:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1789896060.334291:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612160 00000100:00100000:1.0:1789896060.334308:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1789896060.334310:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334333:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1789896060.334349:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003612032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896060.334368:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1789896060.334370:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003612288:12345-0@lo:400:kworker.0 Request processed in 62us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896060.334383:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1789896060.334390:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876838003612544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.334406:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1789896060.334412:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003612032:12345-0@lo:400:kworker.0 Request processed in 68us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896060.334417:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003611648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334424:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1789896060.334453:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789896060.334467:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003612160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.334483:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003611648:12345-0@lo:400:kworker.0 Request processed in 55us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896060.334483:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876838003612544:12345-0@lo:400:kworker.0 Request processed in 85us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896060.334500:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1789896060.334510:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003612160:12345-0@lo:400:kworker.0 Request processed in 43us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896060.334525:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1789896060.334535:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789896060.334542:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003611264 00000100:00100000:3.0:1789896060.334548:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003611264 00000100:00080000:2.0:1789896060.334587:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789896060.334592:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00080000:2.0:1789896060.334595:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789896060.334597:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003611904:0@lo:400:kworker.0 00000100:00080000:2.0:1789896060.334603:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896060.334605:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003611264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789896060.334627:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896060.334673:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003612416:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334680:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003611648:0@lo:400:kworker.0 00000100:00100000:3.0:1789896060.334687:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003611264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896060.334698:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:2.0:1789896060.334712:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa72d4e680 x1876838003612288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896060.334717:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003612160:0@lo:400:kworker.0 00000100:00100000:2.0:1789896060.334744:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003612288:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334752:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003612032:0@lo:400:kworker.0 00000100:00100000:2.0:1789896060.334773:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003611776:0@lo:400:kworker.0 00010000:00080000:1.0:1789896060.334783:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa77148000 x1876838003612544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789896060.334796:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003611392:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334799:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876838003612544:0@lo:400:kworker.0 00000100:00100000:1.0:1789896060.334898:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003611264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896060.378628:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896060.378672:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966592 00000100:00100000:0.0:1789896060.378682:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966592 00000100:00100000:0.0:1789896060.378730:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2798 00000100:00100000:0.0:1789896060.378738:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214608:x1876838015966592:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:0.0:1789896060.378756:0:188730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896060.378774:0:188730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a27e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f671 expref: -99 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378823:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378856:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378866:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378882:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378890:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378901:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378974:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a27f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378980:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a27f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.378985:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a27f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896060.379023:0:188730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000004:00200000:0.0:1789896060.379028:0:188730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789896060.379047:0:188730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a27f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379059:0:188730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379074:0:188730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379080:0:188730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379086:0:188730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b000 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896060.379090:0:188730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379097:0:188730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379108:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5e00) 00010000:00010000:0.0:1789896060.379111:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896060.379116:0:188730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379121:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a27ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379134:0:188730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379139:0:188730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379144:0:188730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379149:0:188730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b600 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896060.379156:0:188730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379162:0:188730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379169:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa655e6900) 00010000:00010000:0.0:1789896060.379172:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896060.379174:0:188730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379179:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a27f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379229:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a27e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f671 expref: 8 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379242:0:188730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a27f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f671 expref: 7 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.379248:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa655e6b00) 00010000:00010000:0.0:1789896060.379249:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789896060.379251:0:188730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a600, rc 0) 00000100:00100000:0.0:1789896060.379297:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:214608:x1876838015966592:12345-192.168.202.44@tcp:101:rm.0 Request processed in 561us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896060.379303:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2798 00000100:00100000:1.0:1789896060.380669:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896060.380711:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966848 00000100:00100000:0.0:1789896060.380718:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966848 00000100:00100000:0.0:1789896060.380755:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2799 00000100:00100000:0.0:1789896060.380763:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:214608:x1876838015966848:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:0.0:1789896060.380783:0:213600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896060.380794:0:213600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a27ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f678 expref: -99 pid: 213600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896060.380866:0:213600:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:0.0:1789896060.380963:0:213600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a27ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f678 expref: 9 pid: 213600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.380975:0:213600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5e00) 00010000:00010000:0.0:1789896060.380977:0:213600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789896060.380981:0:213600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a27ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f678 expref: 9 pid: 213600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.380991:0:213600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5aa00, rc 0) 00000100:00100000:0.0:1789896060.381039:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:214608:x1876838015966848:12345-192.168.202.44@tcp:101:rm.0 Request processed in 277us (374us total) trans 12884904339 rc 301/301 00000100:00100000:0.0:1789896060.381047:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2799 00000100:00100000:3.0:1789896060.382729:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896060.382778:0:188733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015966976 00000100:00100000:2.0:1789896060.382785:0:188733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015966976 00000100:00100000:2.0:1789896060.382820:0:188733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 199 00000100:00100000:2.0:1789896060.382830:0:188733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ea4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:214608:x1876838015966976:12345-192.168.202.44@tcp:37:rm.0 00000100:00100000:2.0:1789896060.384847:0:188733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ea4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:214608:x1876838015966976:12345-192.168.202.44@tcp:37:rm.0 Request processed in 2000us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896060.384859:0:188733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 199 00000100:00100000:1.0:1789896060.386453:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896060.386499:0:193049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015967232 00000100:00100000:0.0:1789896060.386508:0:193049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015967232 00000100:00100000:0.0:1789896060.386562:0:193049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 200 00000100:00100000:0.0:1789896060.386572:0:193049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:214608:x1876838015967232:12345-192.168.202.44@tcp:35:rm.0 00000100:00100000:0.0:1789896060.386742:0:193049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:214608:x1876838015967232:12345-192.168.202.44@tcp:35:rm.0 Request processed in 173us (293us total) trans 12884904340 rc 0/0 00000100:00100000:0.0:1789896060.386747:0:193049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 200 00000100:00100000:3.0:1789896060.387825:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896060.387882:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015967488 00000100:00100000:1.0:1789896060.387888:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015967488 00000100:00100000:1.0:1789896060.387952:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2800 00000100:00100000:1.0:1789896060.387961:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:214608:x1876838015967488:12345-192.168.202.44@tcp:36:rm.0 00010000:00010000:1.0:1789896060.387999:0:188731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789896060.388025:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a27f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f671 expref: 9 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388047:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa655e6b00) 00010000:00010000:1.0:1789896060.388065:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a2272 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5d7 expref: 8 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388076:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5e00) 00010000:00010000:1.0:1789896060.388082:0:188731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896060.388107:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388120:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388130:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388142:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388149:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388168:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388288:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388297:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388304:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789896060.388508:0:188731:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:1.0:1789896060.388522:0:188731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388540:0:188731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388548:0:188731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388555:0:188731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6c00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:1.0:1789896060.388559:0:188731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388566:0:188731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388575:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa43839900) 00010000:00010000:1.0:1789896060.388578:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789896060.388588:0:188731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388595:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a281b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388614:0:188731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388620:0:188731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388626:0:188731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388631:0:188731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7c00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:1.0:1789896060.388634:0:188731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388640:0:188731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388648:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa43839c00) 00010000:00010000:1.0:1789896060.388650:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789896060.388653:0:188731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388658:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a280d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789896060.388670:0:188731:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000004bb05e76 reply state 0000000038806135 transno 12884904341 ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388694:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896060.388700:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa43839000) 00010000:00010000:1.0:1789896060.388702:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789896060.388705:0:188731:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789896060.388763:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:214608:x1876838015967488:12345-192.168.202.44@tcp:36:rm.0 Request processed in 803us (937us total) trans 12884904341 rc 0/0 00000100:00100000:1.0:1789896060.388779:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2800 00000100:00100000:3.0:1789896060.390250:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896060.390283:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015967616 00000100:00100000:0.0:1789896060.390290:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015967616 00000100:00100000:0.0:1789896060.390337:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2801 00000100:00100000:0.0:1789896060.390347:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:213093:x1876838015967616:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789896060.390365:0:190608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896060.390380:0:190608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a2822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f67f expref: -99 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.390424:0:190608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a2829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.390432:0:190608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a2829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.390438:0:190608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a2829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896060.390462:0:190608:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789896060.390464:0:190608:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789896060.390479:0:190608:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a2829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.390498:0:190608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a2822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f67f expref: 11 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.390518:0:190608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a2829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f67f expref: 10 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896060.390524:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6900) 00010000:00010000:0.0:1789896060.390526:0:190608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789896060.390528:0:190608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b800, rc 0) 00000100:00100000:0.0:1789896060.390567:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:213093:x1876838015967616:12345-192.168.202.44@tcp:101:bash.0 Request processed in 222us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896060.390579:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2801 00000100:00100000:0.0:1789896060.391553:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896060.391610:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015967744 00000100:00100000:2.0:1789896060.391614:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015967744 00000100:00100000:2.0:1789896060.391639:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2802 00000100:00100000:2.0:1789896060.391644:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:213093:x1876838015967744:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:2.0:1789896060.391651:0:188732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896060.391661:0:188732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a2830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f686 expref: -99 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391694:0:188732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391704:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391713:0:188732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391725:0:188732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391732:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391755:0:188732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391783:0:188732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391790:0:188732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391797:0:188732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391803:0:188732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9600 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896060.391806:0:188732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391813:0:188732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391822:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6900) 00010000:00010000:2.0:1789896060.391832:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896060.391845:0:188732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391855:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391865:0:188732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391871:0:188732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391883:0:188732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391889:0:188732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9000 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896060.391892:0:188732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391899:0:188732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391909:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7443287c (ffff91aa5c8d2100) 00010000:00010000:2.0:1789896060.391911:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896060.391914:0:188732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391919:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9000/0x412fd4b3617a283e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391944:0:188732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a2830 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f686 expref: 11 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391952:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6900) 00010000:00010000:2.0:1789896060.391954:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896060.391958:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a2830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f686 expref: 11 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896060.391968:0:188732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 00000100:00100000:2.0:1789896060.392002:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:213093:x1876838015967744:12345-192.168.202.44@tcp:101:bash.0 Request processed in 357us (450us total) trans 0 rc 301/301 00000100:00100000:2.0:1789896060.392018:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2802 00010000:00010000:3.0:1789896060.908371:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896061.356337:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003612672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789896061.356406:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896061.356469:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612672 00000100:00100000:0.0:1789896061.356477:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612672 00000100:00100000:0.0:1789896061.356536:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789896061.356546:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003612672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789896061.356581:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789896061.356629:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003612672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896061.356636:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789896061.356669:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003612672:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789896061.473537:0:215805:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789896061.473543:0:215805:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:3.0:1789896061.492510:0:215817:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789896061.492517:0:215817:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000001:00080000:1.0:1789896061.904296:0:188711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904341 is committed 00010000:00010000:3.0:1789896061.904315:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896061.904326:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896061.904332:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896061.904336:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7000 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:3.0:1789896061.904340:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896061.904346:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896061.904361:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa43839000) 00010000:00010000:3.0:1789896061.904363:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789896061.904366:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896061.904370:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a2814 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896061.932321:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789896062.321157:0:215921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3934628955375ns, next at 3819238265902ns, rc = 0 00080000:00080000:3.0:1789896062.321176:0:215921:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789896062.321299:0:215921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3934629099425ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789896062.321306:0:215921:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789896062.321402:0:215921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3934629202103ns, next at 3746909153849ns, rc = 0 00080000:00080000:3.0:1789896062.321409:0:215921:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789896062.321477:0:215921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3934629277870ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789896062.321483:0:215921:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789896062.321906:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 37 committed 00000004:00080000:1.0:1789896062.321959:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000004:00080000:2.0:1789896062.322355:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 37 committed 00000004:00080000:0.0:1789896062.322408:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00000100:00100000:1.0:1789896062.380319:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003612800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789896062.380387:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896062.380448:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612800 00000100:00100000:3.0:1789896062.380456:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612800 00000100:00100000:3.0:1789896062.380509:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789896062.380529:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003612800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789896062.380564:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445875712 avail 1299636224 00000100:00100000:3.0:1789896062.380630:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003612800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896062.380638:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789896062.380654:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003612800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896062.381318:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003612928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896062.381359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896062.381393:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003612928 00000100:00100000:1.0:1789896062.381398:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003612928 00000100:00080000:2.0:1789896062.381437:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789896062.381452:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789896062.381458:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9478a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003612928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789896062.381476:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896062.381509:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9478a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003612928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.381514:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789896062.381552:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003612928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896062.783858:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896062.783910:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015967872 00000100:00100000:0.0:1789896062.783921:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015967872 00000100:00080000:2.0:1789896062.783986:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896062.784005:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2803 00000100:00100000:0.0:1789896062.784015:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214933:x1876838015967872:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896062.786517:0:192111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613056:0@lo:106: 00000100:00100000:1.0:1789896062.786581:0:192111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896062.786628:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613056 00000100:00100000:0.0:1789896062.786635:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613056 00000100:00100000:1.0:1789896062.786650:0:192111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613184:0@lo:106: 00000100:00100000:0.0:1789896062.786698:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1789896062.786699:0:192111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896062.786721:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:192111:x1876838003613056:12345-0@lo:106: 00000100:00100000:2.0:1789896062.786733:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789896062.786736:0:200085:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896062.786739:0:192111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613312:0@lo:106: 00000100:00100000:2.0:1789896062.786749:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613184 00000100:00100000:2.0:1789896062.786755:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613184 00010000:00010000:0.0:1789896062.786766:0:200085:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896062.786776:0:192111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896062.786791:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613312 00000100:00100000:2.0:1789896062.786796:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613312 00000100:00100000:1.0:1789896062.786804:0:192111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613440:0@lo:106: 00000100:00100000:2.0:1789896062.786830:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1789896062.786841:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fa3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:192111:x1876838003613184:12345-0@lo:106: 00010000:00010000:2.0:1789896062.786850:0:188714:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896062.786856:0:192111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896062.786865:0:188714:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896062.786866:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:192111:x1876838003613056:12345-0@lo:106: Request processed in 148us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.786875:0:192111:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896062.786883:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1789896062.786904:0:192111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613056:0@lo:106: 00000100:00100000:0.0:1789896062.786910:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613440 00000100:00100000:0.0:1789896062.786916:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613440 00000100:00100000:2.0:1789896062.786936:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fa3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:192111:x1876838003613184:12345-0@lo:106: Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.786942:0:192111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613184:0@lo:106: 00000100:00100000:2.0:1789896062.786949:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1789896062.786994:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1789896062.787003:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:192111:x1876838003613312:12345-0@lo:106: 00010000:00010000:2.0:1789896062.787018:0:188714:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896062.787027:0:188714:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896062.787029:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1789896062.787042:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:192111:x1876838003613440:12345-0@lo:106: 00010000:00010000:0.0:1789896062.787057:0:200085:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896062.787065:0:200085:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896062.787090:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:192111:x1876838003613312:12345-0@lo:106: Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896062.787098:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1789896062.787118:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:192111:x1876838003613440:12345-0@lo:106: Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896062.787125:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1789896062.787150:0:192111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613312:0@lo:106: 00000100:00100000:2.0:1789896062.787168:0:192111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:192111:1876838003613440:0@lo:106: 00000100:00100000:2.0:1789896062.787302:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214933:x1876838015967872:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 3287us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896062.787313:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2803 00000100:00100000:0.0:1789896062.787377:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003613568:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896062.787410:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003613696:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896062.787413:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896062.787460:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896062.787471:0:189381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613568 00000100:00100000:0.0:1789896062.787477:0:189381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613568 00000100:00100000:1.0:1789896062.787501:0:193050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613696 00000100:00100000:1.0:1789896062.787507:0:193050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613696 00000100:00100000:0.0:1789896062.787516:0:189381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789896062.787527:0:189381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3615:x1876838003613568:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896062.787543:0:193050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789896062.787553:0:193050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0001_UUID+12:3616:x1876838003613696:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896062.787578:0:189381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3615:x1876838003613568:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896062.787593:0:189381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789896062.787607:0:193050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003613696:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.787616:0:193050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789896062.787641:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003613568:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896062.787658:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003613696:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896062.802684:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896062.802739:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968000 00000100:00100000:1.0:1789896062.802750:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968000 00000100:00100000:1.0:1789896062.802822:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2804 00000100:00100000:1.0:1789896062.802834:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214936:x1876838015968000:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:0.0:1789896062.804326:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214936:x1876838015968000:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1492us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896062.804335:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2804 00000100:00100000:0.0:1789896062.820733:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896062.820784:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968128 00000100:00100000:2.0:1789896062.820795:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968128 00000100:00100000:2.0:1789896062.820867:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2805 00000100:00100000:2.0:1789896062.820881:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214939:x1876838015968128:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896062.822748:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214939:x1876838015968128:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1868us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896062.822759:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2805 00000100:00100000:2.0:1789896062.839740:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896062.839783:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968256 00000100:00100000:1.0:1789896062.839793:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968256 00000100:00100000:1.0:1789896062.839854:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2806 00000100:00100000:1.0:1789896062.839872:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214942:x1876838015968256:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896062.842910:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214942:x1876838015968256:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 3032us (3170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.842923:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2806 00000100:00100000:0.0:1789896062.859224:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896062.859280:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968384 00000100:00100000:1.0:1789896062.859290:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968384 00000100:00100000:1.0:1789896062.859357:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2807 00000100:00100000:1.0:1789896062.859368:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214945:x1876838015968384:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896062.861300:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214945:x1876838015968384:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1933us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.861308:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2807 00000100:00100000:0.0:1789896062.870865:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896062.870930:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968512 00000100:00100000:2.0:1789896062.870940:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968512 00000100:00100000:2.0:1789896062.870997:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2808 00000100:00100000:2.0:1789896062.871007:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214946:x1876838015968512:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896062.872889:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214946:x1876838015968512:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1878us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896062.872911:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2808 00000100:00100000:2.0:1789896062.880288:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896062.880340:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968640 00000100:00100000:1.0:1789896062.880350:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968640 00000100:00100000:1.0:1789896062.880397:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2809 00000100:00100000:1.0:1789896062.880405:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214947:x1876838015968640:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896062.882229:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214947:x1876838015968640:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1823us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896062.882237:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2809 00000100:00100000:0.0:1789896062.891858:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896062.891937:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968768 00000100:00100000:2.0:1789896062.891949:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968768 00000100:00100000:2.0:1789896062.892006:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2810 00000100:00100000:2.0:1789896062.892016:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214948:x1876838015968768:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896062.893707:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214948:x1876838015968768:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1689us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896062.893718:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2810 00010000:00010000:1.0:1789896062.956366:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896063.980397:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789896064.483029:0:216018:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 05:21:03 (1789896063) 00000100:00100000:0.0:1789896064.884550:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896064.884595:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015968896 00000100:00100000:0.0:1789896064.884597:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896064.884607:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015968896 00000100:00100000:0.0:1789896064.884634:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896064.884664:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015969024 00000100:00100000:0.0:1789896064.884668:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015969024 00000100:00100000:3.0:1789896064.884680:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2442 00000100:00100000:3.0:1789896064.884694:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015968896:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896064.884711:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015969152 00000100:00100000:0.0:1789896064.884715:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015969152 00000100:00100000:0.0:1789896064.884743:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 545 00000100:00100000:0.0:1789896064.884750:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2403:x1876838015969024:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789896064.884771:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015968896:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896064.884782:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2442 00000100:00100000:0.0:1789896064.884786:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2403:x1876838015969024:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896064.884806:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 545 00000100:00100000:0.0:1789896064.884824:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 546 00000100:00100000:0.0:1789896064.884832:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2404:x1876838015969152:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:3.0:1789896064.884846:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789896064.884857:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896064.884858:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2404:x1876838015969152:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896064.884871:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 546 00010000:00010000:1.0:1789896065.004359:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896065.453378:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789896065.453404:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7714a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003613824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896065.453478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896065.453481:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789896065.453496:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003613952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896065.453533:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613824 00000100:00100000:1.0:1789896065.453533:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896065.453542:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613824 00000100:00100000:1.0:1789896065.453567:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789896065.453578:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003614080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896065.453599:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003613952 00000100:00100000:2.0:1789896065.453603:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003613952 00000100:00100000:1.0:1789896065.453617:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896065.453631:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614080 00000100:00100000:2.0:1789896065.453636:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614080 00000100:00100000:1.0:1789896065.453659:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789896065.453671:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789896065.453672:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003613824:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896065.453684:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003613952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789896065.453700:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789896065.453700:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896065.453757:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003613824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896065.453764:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003613952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896065.453766:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789896065.453777:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789896065.453806:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789896065.453815:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003614080:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789896065.453821:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789896065.453829:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789896065.453832:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789896065.453863:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003614080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896065.453869:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789896065.453898:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003614208:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.453907:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003614592:0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.453935:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896065.453964:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896065.453996:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003614080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789896065.454003:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003615104:0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454021:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003614720:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454042:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896065.454058:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896065.454086:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003615232:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454090:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614592 00000100:00100000:0.0:1789896065.454096:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614592 00000100:00100000:1.0:1789896065.454110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896065.454136:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789896065.454140:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615104 00000100:00100000:2.0:1789896065.454146:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615104 00000100:00100000:0.0:1789896065.454149:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003614592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454160:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614208 00000100:00100000:1.0:1789896065.454166:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614208 00000100:00100000:2.0:1789896065.454193:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615232 00000100:00100000:2.0:1789896065.454218:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615232 00000100:00100000:1.0:1789896065.454228:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1789896065.454241:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3616:x1876838003614208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454241:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003614592:12345-0@lo:400:kworker.0 Request processed in 93us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896065.454254:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1789896065.454255:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789896065.454270:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003615104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454293:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1789896065.454303:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3616:x1876838003614208:12345-0@lo:400:kworker.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896065.454305:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003615232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454319:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:2.0:1789896065.454324:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003615104:12345-0@lo:400:kworker.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896065.454334:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1789896065.454364:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003615232:12345-0@lo:400:kworker.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896065.454371:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003614336:0@lo:400:kworker.0 00000100:00080000:2.0:1789896065.454373:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896065.454377:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00080000:2.0:1789896065.454381:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789896065.454407:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614720 00000100:00100000:1.0:1789896065.454412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896065.454413:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614720 00000100:00100000:3.0:1789896065.454441:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614336 00000100:00100000:3.0:1789896065.454447:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614336 00000100:00100000:1.0:1789896065.454447:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7714ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876838003614848:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454464:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789896065.454474:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003614720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454479:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896065.454492:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789896065.454503:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003614336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454506:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876838003615360:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454522:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003614720:12345-0@lo:400:kworker.0 Request processed in 50us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896065.454530:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789896065.454548:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789896065.454555:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896065.454557:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003614336:12345-0@lo:400:kworker.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896065.454568:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789896065.454578:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614848 00000100:00100000:2.0:1789896065.454584:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614848 00000100:00100000:1.0:1789896065.454592:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003613952:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789896065.454600:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa77148000 x1876838003615104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789896065.454614:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003615104:0@lo:400:kworker.0 00000100:00100000:2.0:1789896065.454617:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615360 00000100:00100000:2.0:1789896065.454622:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615360 00000100:00100000:1.0:1789896065.454625:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003614336:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454633:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003614592:0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454640:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789896065.454649:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7714b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876838003614464:0@lo:400:kworker.0 00000100:00100000:2.0:1789896065.454656:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00080000:0.0:1789896065.454660:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789896065.454667:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3617:x1876838003614848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454677:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896065.454704:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003614976:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454708:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7714a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003613824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896065.454715:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3617:x1876838003614848:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896065.454724:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789896065.454731:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896065.454742:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614464 00000100:00100000:0.0:1789896065.454745:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003614720:0@lo:400:kworker.0 00000100:00100000:2.0:1789896065.454747:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614464 00000100:00100000:1.0:1789896065.454764:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7714ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876838003614848:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454770:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003615232:0@lo:400:kworker.0 00000100:00100000:2.0:1789896065.454772:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003614976 00000100:00100000:2.0:1789896065.454777:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003614976 00000100:00100000:0.0:1789896065.454800:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003614208:0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454809:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1789896065.454821:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876838003615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896065.454832:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00080000:0.0:1789896065.454835:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896065.454843:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3617:x1876838003614464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454852:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1789896065.454865:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876838003615360:12345-0@lo:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896065.454865:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3617:x1876838003614976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896065.454879:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1789896065.454888:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3617:x1876838003614464:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896065.454905:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1789896065.454916:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7714b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876838003614464:0@lo:400:kworker.0 00000100:00100000:0.0:1789896065.454920:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3617:x1876838003614976:12345-0@lo:400:kworker.0 Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896065.454931:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1789896065.454943:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003614976:0@lo:400:kworker.0 00010000:00080000:1.0:1789896065.454957:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a948ee0e00 x1876838003615360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896065.454965:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876838003615360:0@lo:400:kworker.0 00000020:00000004:0.0:1789896065.581375:0:216193:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789896065.581383:0:216193:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1789896065.589020:0:216199:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789896065.589027:0:216199:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789896065.603145:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896065.603172:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015969280 00000100:00100000:0.0:1789896065.603181:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015969280 00000100:00100000:0.0:1789896065.603247:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2811 00000100:00100000:0.0:1789896065.603260:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215242:x1876838015969280:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789896065.603280:0:188731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896065.603308:0:188731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a2845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f68d expref: -99 pid: 188731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603362:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603373:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603382:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603393:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603398:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603403:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603438:0:188731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603443:0:188731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603448:0:188731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603453:0:188731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b600 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896065.603456:0:188731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603472:0:188731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603486:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6900) 00010000:00010000:0.0:1789896065.603489:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896065.603495:0:188731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603502:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a284c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603516:0:188731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603520:0:188731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603524:0:188731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603528:0:188731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b000 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896065.603530:0:188731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603534:0:188731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603540:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff91aa655e6e00) 00010000:00010000:0.0:1789896065.603542:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896065.603544:0:188731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603553:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2853 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603578:0:188731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a2845 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f68d expref: 7 pid: 188731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603586:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6900) 00010000:00010000:0.0:1789896065.603587:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896065.603590:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5aa00/0x412fd4b3617a2845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f68d expref: 7 pid: 188731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896065.603597:0:188731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5aa00, rc 0) 00000100:00100000:0.0:1789896065.603644:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215242:x1876838015969280:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 390us (505us total) trans 0 rc 301/301 00000100:00100000:0.0:1789896065.603649:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2811 00000100:00100000:0.0:1789896065.605590:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896065.605632:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015969536 00000100:00100000:1.0:1789896065.605638:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015969536 00000100:00100000:1.0:1789896065.605677:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2812 00000100:00100000:1.0:1789896065.605686:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215242:x1876838015969536:12345-192.168.202.44@tcp:36:lfs.0 00010000:00010000:1.0:1789896065.605723:0:213600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896065.605738:0:213600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a2829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f67f expref: 6 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.605753:0:213600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6900) 00010000:00010000:1.0:1789896065.605762:0:213600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896065.605810:0:213600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.605821:0:213600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.605830:0:213600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.605842:0:213600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.605850:0:213600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.605865:0:213600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606441:0:213600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606450:0:213600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606458:0:213600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789896065.606473:0:213600:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000064aa7f92 reply state 0000000013aeaf6d transno 12884904342 ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606484:0:213600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606490:0:213600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff91aa65643600) 00010000:00010000:1.0:1789896065.606493:0:213600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789896065.606496:0:213600:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789896065.606500:0:213600:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00010000:00010000:1.0:1789896065.606507:0:213600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606513:0:213600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606519:0:213600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606525:0:213600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7000 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:1.0:1789896065.606536:0:213600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606543:0:213600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606553:0:213600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa65643000) 00010000:00010000:1.0:1789896065.606556:0:213600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789896065.606559:0:213600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606566:0:213600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7000/0x412fd4b3617a285a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789896065.606586:0:213600:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000064aa7f92 reply state 0000000013aeaf6d transno 12884904342 ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606595:0:213600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.606602:0:213600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff91aa65643f00) 00010000:00010000:1.0:1789896065.606605:0:213600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789896065.606607:0:213600:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789896065.606663:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:215242:x1876838015969536:12345-192.168.202.44@tcp:36:lfs.0 Request processed in 977us (1073us total) trans 12884904342 rc 0/0 00000100:00100000:1.0:1789896065.606671:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2812 00000100:00100000:1.0:1789896065.610592:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896065.610621:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015969664 00000100:00100000:3.0:1789896065.610629:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015969664 00000100:00100000:3.0:1789896065.610671:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2813 00000100:00100000:3.0:1789896065.610681:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:215243:x1876838015969664:12345-192.168.202.44@tcp:101:chmod.0 00010000:00010000:3.0:1789896065.610699:0:188730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896065.610715:0:188730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a286f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f694 expref: -99 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.610759:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2a00/0x412fd4b3617a2876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.610769:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2a00/0x412fd4b3617a2876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.610778:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2a00/0x412fd4b3617a2876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789896065.610820:0:188730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789896065.610824:0:188730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789896065.610839:0:188730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2a00/0x412fd4b3617a2876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.610868:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a286f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f694 expref: 9 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.610885:0:188730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2a00/0x412fd4b3617a2876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f694 expref: 8 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.610892:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5600) 00010000:00010000:3.0:1789896065.610895:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789896065.610897:0:188730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2a00, rc 0) 00000100:00100000:3.0:1789896065.610939:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:215243:x1876838015969664:12345-192.168.202.44@tcp:101:chmod.0 Request processed in 261us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896065.610945:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2813 00000100:00100000:3.0:1789896065.611744:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896065.611794:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015969792 00000100:00100000:1.0:1789896065.611799:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015969792 00000100:00100000:1.0:1789896065.611842:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2814 00000100:00100000:1.0:1789896065.611853:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:215243:x1876838015969792:12345-192.168.202.44@tcp:101:chmod.0 00010000:00010000:1.0:1789896065.611870:0:192111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896065.611888:0:192111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a287d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f69b expref: -99 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.611926:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.611936:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.611944:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.611956:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.611962:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.611970:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612024:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6200/0x412fd4b3617a2892 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612033:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6200/0x412fd4b3617a2892 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612040:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6200/0x412fd4b3617a2892 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789896065.612060:0:192111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00000004:00200000:1.0:1789896065.612069:0:192111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789896065.612084:0:192111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6200/0x412fd4b3617a2892 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612094:0:192111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612100:0:192111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612106:0:192111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612112:0:192111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7c00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:1.0:1789896065.612116:0:192111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612123:0:192111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612143:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5600) 00010000:00010000:1.0:1789896065.612146:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789896065.612151:0:192111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612157:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7c00/0x412fd4b3617a2884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612170:0:192111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612176:0:192111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612193:0:192111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612271:0:192111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7600 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:1.0:1789896065.612275:0:192111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612283:0:192111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612294:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff91aa65643f00) 00010000:00010000:1.0:1789896065.612297:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789896065.612301:0:192111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612307:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7600/0x412fd4b3617a288b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612328:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6c00/0x412fd4b3617a287d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f69b expref: 10 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612338:0:192111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6200/0x412fd4b3617a2892 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f69b expref: 9 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896065.612343:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff91aa65643600) 00010000:00010000:1.0:1789896065.612345:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789896065.612347:0:192111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6200, rc 0) 00000100:00100000:1.0:1789896065.612384:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:215243:x1876838015969792:12345-192.168.202.44@tcp:101:chmod.0 Request processed in 534us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896065.612401:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2814 00000100:00100000:1.0:1789896065.613402:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896065.613428:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970048 00000100:00100000:3.0:1789896065.613434:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970048 00000100:00100000:3.0:1789896065.613470:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2815 00000100:00100000:3.0:1789896065.613478:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:215243:x1876838015970048:12345-192.168.202.44@tcp:36:chmod.0 00010000:00010000:3.0:1789896065.613508:0:188732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896065.613524:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6200/0x412fd4b3617a2892 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f69b expref: 9 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.613537:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff91aa65643600) 00010000:00010000:3.0:1789896065.613541:0:188732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896065.613554:0:188732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.613563:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.613577:0:188732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789896065.613693:0:188732:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000f143aafc reply state 00000000a7ec943d transno 12884904343 ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.613704:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896065.613710:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff91aa65643600) 00010000:00010000:3.0:1789896065.613713:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789896065.613715:0:188732:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789896065.613721:0:188732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00000100:00100000:3.0:1789896065.613770:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:215243:x1876838015970048:12345-192.168.202.44@tcp:36:chmod.0 Request processed in 291us (366us total) trans 12884904343 rc 0/0 00000100:00100000:3.0:1789896065.613778:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2815 00010000:00010000:1.0:1789896066.029294:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789896066.328296:0:216306:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3e1305c0 20000000:00000080:2.0:1789896066.328313:0:216306:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a94f46cc00 uarg=0000000000000000 20000000:01000000:2.0:1789896066.328353:0:216306:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789896066.328355:0:216306:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789896066.328358:0:216306:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=ugp' 20000000:01000000:2.0:1789896066.328363:0:216306:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'quota.ost=ugp' 20000000:01000000:2.0:1789896066.328368:0:216306:0:(mgs_llog.c:4246:mgs_write_log_quota()) global 'quota.ost=ugp' 20000000:01000000:2.0:1789896066.328425:0:216306:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789896066.328428:0:216306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896066.328799:0:216307:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 182 marker 169 1->4: lustre quota.ost 20000000:01000000:1.0:1789896066.328840:0:216307:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 184 marker 169 2->4: lustre quota.ost 00000040:00080000:1.0:1789896066.328851:0:216307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 215 count 211 00000040:00080000:2.0:1789896066.328965:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].215, 224 off47688 00000040:00080000:2.0:1789896066.328982:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].216, 88 off47776 00000040:00080000:2.0:1789896066.328990:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].217, 224 off48000 20000000:01000000:2.0:1789896066.328996:0:216306:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789896066.328997:0:216306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896066.329474:0:216308:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 182 marker 170 1->4: lustre quota.ost 20000000:01000000:1.0:1789896066.329498:0:216308:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 184 marker 170 2->4: lustre quota.ost 00000040:00080000:1.0:1789896066.329521:0:216308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 215 count 211 00000040:00080000:2.0:1789896066.329676:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].215, 224 off47688 00000040:00080000:2.0:1789896066.329689:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].216, 88 off47776 00000040:00080000:2.0:1789896066.329697:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].217, 224 off48000 20000000:01000000:2.0:1789896066.329703:0:216306:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789896066.329705:0:216306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896066.329909:0:216309:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 35 marker 171 1->4: lustre quota.ost 20000000:01000000:1.0:1789896066.329932:0:216309:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 171 2->4: lustre quota.ost 00000040:00080000:1.0:1789896066.329944:0:216309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 38 00000040:00080000:2.0:1789896066.330007:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14992 00000040:00080000:2.0:1789896066.330028:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 88 off15080 00000040:00080000:2.0:1789896066.330045:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 224 off15304 20000000:01000000:2.0:1789896066.330057:0:216306:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789896066.330060:0:216306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896066.330259:0:216310:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 172 1->4: lustre quota.ost 20000000:01000000:1.0:1789896066.330286:0:216310:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 172 2->4: lustre quota.ost 00000040:00080000:1.0:1789896066.330300:0:216310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 41 count 41 00000040:00080000:2.0:1789896066.330375:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 224 off15520 00000040:00080000:2.0:1789896066.330397:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 88 off15608 00000040:00080000:2.0:1789896066.330414:0:216306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15832 10000000:01000000:2.0:1789896066.330427:0:216306:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896066.330445:0:216306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330467:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330475:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330483:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330490:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330496:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330503:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a278f expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330509:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a279d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330516:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330523:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330529:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330547:0:216306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330555:0:216306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330594:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330606:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.330617:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615488:0@lo:104: 00000100:00100000:2.0:1789896066.330668:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896066.330705:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615488 00010000:00010000:2.0:1789896066.330712:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.330712:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615488 00010000:00010000:2.0:1789896066.330719:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.330725:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615616:0@lo:104: 00000100:00100000:2.0:1789896066.330740:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896066.330756:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615616 00000100:00100000:1.0:1789896066.330759:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615616 00010000:00010000:2.0:1789896066.330771:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330789:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.330795:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615744:0@lo:104: 00000100:00100000:3.0:1789896066.330799:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1789896066.330809:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1789896066.330814:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003615488:12345-0@lo:104: 00000100:00100000:1.0:1789896066.330821:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003615616:12345-0@lo:104: 00010000:00010000:3.0:1789896066.330826:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.330829:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.330832:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896066.330856:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615744 00010000:00010000:2.0:1789896066.330858:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.330861:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615744 00010000:00010000:2.0:1789896066.330867:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.330876:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615872:0@lo:104: 00010000:00010000:3.0:1789896066.330897:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789896066.330901:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00010000:00010000:1.0:1789896066.330904:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789896066.330909:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896066.330916:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216306:x1876838003615744:12345-0@lo:104: 00000100:00100000:3.0:1789896066.330917:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216306:x1876838003615488:12345-0@lo:104: Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896066.330917:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216306:x1876838003615616:12345-0@lo:104: Request processed in 95us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896066.330928:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.330932:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a279d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.330933:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1789896066.330942:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00010000:00010000:2.0:1789896066.330953:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a279d expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.330954:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789896066.330964:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616000:0@lo:104: 00000100:00100000:1.0:1789896066.330965:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003615872 00000100:00100000:1.0:1789896066.330969:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003615872 00010000:00010000:3.0:1789896066.330975:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789896066.330984:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789896066.330986:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.330992:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003615744:12345-0@lo:104: Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896066.330999:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896066.331001:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00010000:00010000:3.0:1789896066.331011:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5be00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896066.331013:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003615872:12345-0@lo:104: 10000000:00010000:3.0:1789896066.331016:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.331019:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00010000:1.0:1789896066.331024:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331025:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a278f expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331026:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.331041:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616000 00000100:00100000:0.0:1789896066.331047:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616000 10000000:00010000:3.0:1789896066.331049:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331051:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a278f expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896066.331061:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896066.331067:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789896066.331068:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616128:0@lo:104: 00000100:00100000:0.0:1789896066.331078:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003616000:12345-0@lo:104: 00010000:00010000:1.0:1789896066.331081:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789896066.331086:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331087:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003615872:12345-0@lo:104: Request processed in 76us (180us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896066.331091:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331097:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896066.331109:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896066.331112:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00010000:00010000:2.0:1789896066.331118:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331125:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331137:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331138:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789896066.331143:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616384:0@lo:104: 00000100:00100000:0.0:1789896066.331149:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216306:x1876838003616000:12345-0@lo:104: Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896066.331152:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616128 00010000:00010000:3.0:1789896066.331158:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a27d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27dc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331159:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616128 00000100:00100000:0.0:1789896066.331162:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789896066.331172:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896066.331181:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616384 00010000:00010000:3.0:1789896066.331183:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789896066.331186:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616384 00010000:00010000:3.0:1789896066.331188:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331189:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00010000:00010000:2.0:1789896066.331196:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331221:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331224:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003616128:12345-0@lo:104: 00000100:00100000:0.0:1789896066.331231:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00010000:00010000:3.0:1789896066.331232:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7800 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896066.331237:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896066.331239:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331243:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616512:0@lo:104: 00000100:00100000:0.0:1789896066.331244:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003616384:12345-0@lo:104: 00010000:00010000:0.0:1789896066.331258:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331270:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896066.331283:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331289:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:00010000:3.0:1789896066.331290:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331297:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216306:x1876838003616128:12345-0@lo:104: Request processed in 97us (200us total) trans 0 rc 0/0 10000000:01000000:3.0:1789896066.331301:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896066.331307:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:2.0:1789896066.331308:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331311:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789896066.331321:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616512 00000100:00100000:0.0:1789896066.331321:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216306:x1876838003616384:12345-0@lo:104: Request processed in 80us (149us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896066.331323:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331324:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331327:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616512 00000100:00100000:0.0:1789896066.331341:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00010000:00010000:3.0:1789896066.331346:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896066.331350:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616640:0@lo:104: 00000100:00100000:1.0:1789896066.331359:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00010000:00010000:3.0:1789896066.331368:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331369:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216306:x1876838003616512:12345-0@lo:104: 00000100:00100000:2.0:1789896066.331378:0:216306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896066.331382:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789896066.331383:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331386:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a27c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27ce expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331394:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331411:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331413:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b400 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896066.331414:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:00010000:0.0:1789896066.331420:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331421:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331430:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 9 pid: 188723 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331430:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1789896066.331441:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7200 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896066.331443:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216306:x1876838003616512:12345-0@lo:104: Request processed in 75us (173us total) trans 0 rc 0/0 10000000:00010000:3.0:1789896066.331446:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331455:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616896:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896066.331466:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00010000:00010000:3.0:1789896066.331468:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331469:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896066.331480:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331481:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616640 00000100:00100000:1.0:1789896066.331486:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616640 10000000:00010000:0.0:1789896066.331494:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896066.331495:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896066.331505:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 10000000:01000000:0.0:1789896066.331506:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896066.331511:0:216306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331513:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216306:x1876838003616640:12345-0@lo:104: 00010000:00010000:3.0:1789896066.331519:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331525:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331528:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331535:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896066.331545:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.331547:0:216306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 9 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331548:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896066.331560:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331562:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7200/0x412fd4b3617a27ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331570:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789896066.331575:0:216306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003617024:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896066.331582:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216306:x1876838003616640:12345-0@lo:104: Request processed in 68us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896066.331582:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a27b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27c0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331585:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789896066.331591:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331599:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00010000:00010000:3.0:1789896066.331605:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b200 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896066.331607:0:216306:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789896066.331607:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:00010000:3.0:1789896066.331608:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331613:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331618:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331618:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789896066.331621:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ac00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896066.331624:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896066.331626:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331632:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615488:0@lo:104: 10000000:00010000:3.0:1789896066.331634:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331646:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615616:0@lo:104: 00010000:00010000:1.0:1789896066.331646:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7e00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896066.331648:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896066.331653:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789896066.331653:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331658:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615744:0@lo:104: 10000000:00010000:0.0:1789896066.331668:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331671:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331671:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331674:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003615872:0@lo:104: 00000100:00100000:2.0:1789896066.331687:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616000:0@lo:104: 00010000:00010000:3.0:1789896066.331693:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789896066.331694:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896066.331695:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896066.331699:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616128:0@lo:104: 00010000:00010000:3.0:1789896066.331707:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331710:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616384:0@lo:104: 10000000:01000000:1.0:1789896066.331712:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896066.331719:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331721:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a279d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a27a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.331723:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616512:0@lo:104: 00000100:00100000:2.0:1789896066.331735:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616640:0@lo:104: 00010000:00010000:1.0:1789896066.331739:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331741:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896066.331744:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896066.331749:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331752:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331754:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896066.331762:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ba00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896066.331764:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896066.331767:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331767:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a278f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2796 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331795:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331796:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a2781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2788 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331800:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896066.331806:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896066.331812:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331822:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7400 already unused, calling callback (ffffffffc1214c20) 10000000:01000000:3.0:1789896066.331823:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896066.331826:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789896066.331827:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331830:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896066.331835:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896066.331835:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331837:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.331845:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896066.331852:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789896066.331852:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.331857:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896066.331859:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896066.331867:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a277a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331873:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003616256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896066.331878:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.331892:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896066.331896:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896066.331899:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896066.331901:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896066.331907:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.331916:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896066.331917:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a276c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896066.331920:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003617280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896066.331939:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896066.331941:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896066.331944:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896066.331953:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896066.331954:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003617408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.331957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896066.331958:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616256 00000100:00100000:2.0:1789896066.331963:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616256 00000100:00100000:3.0:1789896066.331982:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003617792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896066.331985:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 24 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.331987:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003617152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896066.331995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896066.332018:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617280 00000100:00100000:3.0:1789896066.332022:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896066.332022:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617280 00000100:00100000:1.0:1789896066.332029:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003617920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896066.332030:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003616768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896066.332035:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 25 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.332054:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617408 00000100:00100000:2.0:1789896066.332061:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617408 00000100:00100000:1.0:1789896066.332068:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896066.332074:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a279d expref: 26 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.332088:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617792 00000100:00100000:2.0:1789896066.332090:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617792 00000100:00100000:0.0:1789896066.332093:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617920 00000100:00100000:0.0:1789896066.332098:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617920 00010000:00010000:2.0:1789896066.332101:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 27 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.332116:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 28 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.332118:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1789896066.332121:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896066.332129:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3618:x1876838003616256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896066.332138:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896066.332139:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003616768 00000100:00100000:0.0:1789896066.332142:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003616768 00010000:00010000:2.0:1789896066.332144:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 28 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.332144:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003617536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896066.332154:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 29 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.332160:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 29 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.332175:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a27dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a27d5 expref: 29 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.332181:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1789896066.332186:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896066.332192:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00010000:00010000:2.0:1789896066.332193:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896066.332222:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003617280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332231:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3618:x1876838003617408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896066.332235:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896066.332241:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896066.332243:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 28 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.332246:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3618:x1876838003616256:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896066.332261:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1789896066.332264:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003616256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896066.332265:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 28 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.332288:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a27c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a27b9 expref: 27 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.332300:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896066.332302:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a279d expref: 28 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.332311:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617536 00000100:00100000:2.0:1789896066.332316:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00010000:00010000:3.0:1789896066.332317:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a279d expref: 26 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.332323:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617536 00000100:00100000:2.0:1789896066.332331:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3617:x1876838003617792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896066.332334:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a27a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a279d expref: 27 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.332341:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3617:x1876838003617280:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (386us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896066.332343:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a278f expref: 27 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.332344:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896066.332353:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896066.332355:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 26 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.332357:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00010000:00010000:2.0:1789896066.332373:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 25 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.332380:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1789896066.332387:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00010000:00010000:2.0:1789896066.332391:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6000/0x412fd4b3617a277a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2773 expref: 25 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.332391:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003617920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332397:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003617408:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896066.332403:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003616768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896066.332406:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896066.332416:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 24 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896066.332417:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00010000:00010000:2.0:1789896066.332418:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896066.332420:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896066.332428:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 24 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.332435:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896066.332442:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1789896066.332452:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003617536:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896066.332452:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3617:x1876838003617792:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (431us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896066.332458:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.332464:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896066.332472:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00010000:00010000:3.0:1789896066.332475:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a278f expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.332479:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a276c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2765 expref: 23 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.332484:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a27ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a27c7 expref: 23 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.332487:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a278f expref: 22 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.332504:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896066.332510:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a2796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a278f expref: 20 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896066.332510:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896066.332520:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896066.332539:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3618:x1876838003617920:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896066.332544:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1789896066.332564:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3615:x1876838003617536:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896066.332564:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3615:x1876838003616768:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896066.332575:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003616768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332579:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1789896066.332586:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896066.332589:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1789896066.332596:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003617536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332608:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617152 00000100:00100000:3.0:1789896066.332613:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617152 00000100:00100000:0.0:1789896066.332615:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003617664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896066.332638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896066.332661:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003617664 00000100:00100000:2.0:1789896066.332665:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003617664 00010000:00010000:2.0:1789896066.332677:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 18 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896066.332695:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003617280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896066.332699:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00010000:00010000:3.0:1789896066.332707:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 18 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.332712:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3616:x1876838003617664:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896066.332717:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003617792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896066.332723:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896066.332729:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 18 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.332737:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 18 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.332737:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003617920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332747:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00010000:00010000:2.0:1789896066.332748:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2781 expref: 18 pid: 188725 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896066.332760:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3616:x1876838003617152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896066.332765:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896066.332765:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003617408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896066.332768:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896066.332787:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 17 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.332795:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 17 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.332804:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a27b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a27ab expref: 17 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896066.332811:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3616:x1876838003617664:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (170us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896066.332813:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896066.332819:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1789896066.332824:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003617664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332852:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003617152:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896066.332855:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003617152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896066.332861:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1789896066.333379:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003617024:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896066.333720:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896066.333734:0:216306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216306:1876838003616896:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896066.333754:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896066.333757:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970304 00000100:00100000:0.0:1789896066.333761:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970304 00010000:00010000:0.0:1789896066.333790:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 10 pid: 188723 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.333807:0:216306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.333814:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970176 00000100:00100000:0.0:1789896066.333819:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970176 00000100:00100000:3.0:1789896066.333826:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 581 00010000:00010000:0.0:1789896066.333834:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 11 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896066.333842:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015970304:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789896066.333853:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896066.333864:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 582 00010000:00010000:3.0:1789896066.333869:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 11 pid: 188723 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.333879:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015970176:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789896066.333886:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 11 pid: 188723 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.333890:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896066.333897:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 11 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.333906:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 11 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.333916:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a275e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f66a expref: 11 pid: 188723 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.333918:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a2757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f663 expref: 11 pid: 188726 timeout: 4038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.333947:0:191756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.333956:0:191756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896066.333964:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896066.333970:0:191756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.333980:0:191756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.333986:0:191756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.333993:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015970176:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 121us (241us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896066.333995:0:191756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896066.334006:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 582 00010000:00010000:3.0:1789896066.334016:0:191756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8000 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:3.0:1789896066.334022:0:191756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.334030:0:191756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.334047:0:191756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896066.334058:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896066.334070:0:216306:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.334079:0:216306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896066.334084:0:216306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a28a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896066.334095:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+8:2403:x1876838015970304:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 257us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896066.334171:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 581 00000100:00100000:2.0:1789896066.476332:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003618048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789896066.476403:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896066.476452:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618048 00000100:00100000:0.0:1789896066.476461:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618048 00000100:00100000:0.0:1789896066.476511:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789896066.476521:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003618048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789896066.476556:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789896066.476612:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003618048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896066.476620:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789896066.476646:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003618048:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789896067.052450:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896067.501313:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789896067.501313:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789896067.501336:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003618176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789896067.501336:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003618304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896067.501411:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896067.501414:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896067.501452:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618176 00000100:00100000:2.0:1789896067.501460:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618176 00000100:00100000:3.0:1789896067.501469:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618304 00000100:00100000:3.0:1789896067.501474:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618304 00000100:00080000:1.0:1789896067.501496:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896067.501518:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789896067.501523:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789896067.501530:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003618304:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896067.501537:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003618176:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:3.0:1789896067.501566:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00002000:00000024:2.0:1789896067.501566:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896067.501611:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003618304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896067.501617:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789896067.501630:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003618176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896067.501639:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789896067.501653:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003618304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896067.501668:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003618176:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1789896068.007708:0:216551:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: User quota (block hardlimit:50 MB) 10000000:01000000:3.0:1789896068.012322:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896068.012326:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 190 10000000:01000000:3.0:1789896068.012330:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896068.012371:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.012383:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.012395:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.012455:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.012515:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.012563:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618432 00000100:00100000:3.0:1789896068.012567:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.012571:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618432 00000100:00100000:1.0:1789896068.012636:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1789896068.012646:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003618432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.012658:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896068.012679:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28a7 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.012699:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.012708:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.012714:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7600, rc 0) 00000100:00100000:1.0:1789896068.012750:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003618432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.012769:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1789896068.012811:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.012822:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.012829:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.012883:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.012911:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.012931:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896068.012957:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618560 00000100:00100000:0.0:1789896068.012964:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618560 00000100:00100000:0.0:1789896068.012999:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1789896068.013008:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003618560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.013142:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003618560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.013148:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:1.0:1789896068.013175:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.013250:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.013306:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.013338:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618688 00000100:00100000:1.0:1789896068.013340:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896068.013342:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618688 00000100:00100000:0.0:1789896068.013369:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:0.0:1789896068.013378:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003618688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.013472:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003618688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.013482:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:1.0:1789896068.013507:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896068.014184:0:216553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:0.0:1789896068.014277:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:0.0:1789896068.014305:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896068.014313:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.014328:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896068.014335:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789896068.014337:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789896068.014340:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896068.014357:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.014364:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.014371:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.014381:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.014410:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.014434:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9531516c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.014445:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618816 00000100:00100000:1.0:1789896068.014450:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618816 00000100:00100000:1.0:1789896068.014476:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:1.0:1789896068.014484:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003618816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.014492:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896068.014501:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28b5 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.014516:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.014525:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.014532:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7c00, rc 0) 00000100:00100000:1.0:1789896068.014566:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003618816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.014573:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:0.0:1789896068.014588:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896068.014602:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.014610:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.014653:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.014680:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.014706:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9531516c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.014708:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003618944 00000100:00100000:1.0:1789896068.014713:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003618944 00000100:00100000:1.0:1789896068.014738:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448 00000100:00100000:1.0:1789896068.014746:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003618944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.014829:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003618944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.014836:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448 00000100:00100000:0.0:1789896068.014853:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003618944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.014894:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.014926:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.014941:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9531516c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.014958:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619072 00000100:00100000:1.0:1789896068.014963:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619072 00000100:00100000:1.0:1789896068.014989:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1789896068.014995:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003619072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.015058:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003619072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.015065:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:0.0:1789896068.015073:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.015255:0:216554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216554:1876838003619200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896068.015289:0:216554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.015310:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619200 00000100:00100000:1.0:1789896068.015315:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619200 00000100:00100000:0.0:1789896068.015316:0:216554:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947540 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.015344:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1789896068.015353:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:216554:x1876838003619200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.015425:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:216554:x1876838003619200:12345-0@lo:502:llog_process_th.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.015433:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:0.0:1789896068.015442:0:216554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216554:1876838003619200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896068.015467:0:216554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896068.015477:0:216554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896068.015480:0:216554:0:(obd_config.c:1561:class_process_config()) marker 205 (0x1) lustre quota.ost 00000020:00000080:0.0:1789896068.015486:0:216554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789896068.015508:0:216554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216554:1876838003619328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896068.015547:0:216554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.015569:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619328 00000100:00100000:0.0:1789896068.015569:0:216554:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947540 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.015574:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619328 00000100:00100000:1.0:1789896068.015602:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1789896068.015611:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:216554:x1876838003619328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.015681:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:216554:x1876838003619328:12345-0@lo:502:llog_process_th.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.015695:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1789896068.015695:0:216554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216554:1876838003619328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896068.015722:0:216554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896068.015727:0:216554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896068.015729:0:216554:0:(obd_config.c:1561:class_process_config()) marker 205 (0x2) lustre quota.ost 00000040:00080000:0.0:1789896068.015733:0:216554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 41 00000020:01000000:1.0:1789896068.015798:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-40 (rc=0) 10000000:01000000:1.0:1789896068.015822:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789896068.015828:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.015837:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896068.015846:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896068.015848:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 190 10000000:01000000:1.0:1789896068.015851:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896068.015866:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.015874:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.015882:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.015895:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.015924:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.015943:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9516ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896068.015958:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619456 00000100:00100000:0.0:1789896068.015964:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619456 00000100:00100000:0.0:1789896068.015992:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:0.0:1789896068.016002:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003619456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896068.016017:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896068.016027:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28c3 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.016042:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.016051:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.016058:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ba00, rc 0) 00000100:00100000:0.0:1789896068.016093:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003619456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.016101:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:1.0:1789896068.016103:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.016118:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.016136:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.016173:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.016215:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.016240:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619584 00000100:00100000:0.0:1789896068.016245:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619584 00000100:00100000:1.0:1789896068.016249:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9516ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896068.016276:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453 00000100:00100000:0.0:1789896068.016284:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003619584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.016336:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003619584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.016342:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453 00000100:00100000:1.0:1789896068.016353:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.016378:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.016413:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.016430:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9516ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896068.016434:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619712 00000100:00100000:0.0:1789896068.016439:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619712 00000100:00100000:0.0:1789896068.016469:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:0.0:1789896068.016477:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003619712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.016529:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003619712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.016542:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:1.0:1789896068.016544:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896068.017130:0:216555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789896068.017184:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789896068.017239:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896068.017247:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.017256:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896068.017263:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789896068.017266:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789896068.017268:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896068.017286:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.017293:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.017311:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.017325:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.017358:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.017385:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619840 00000100:00100000:1.0:1789896068.017391:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619840 00000100:00100000:3.0:1789896068.017396:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.017425:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:1.0:1789896068.017433:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003619840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.017441:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896068.017450:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28d1 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.017466:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.017475:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.017493:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6a00, rc 0) 00000100:00100000:1.0:1789896068.017534:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003619840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.017541:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1789896068.017566:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896068.017579:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.017585:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.017646:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.017671:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.017689:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.017692:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003619968 00000100:00100000:1.0:1789896068.017697:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003619968 00000100:00100000:1.0:1789896068.017724:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:1.0:1789896068.017733:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003619968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.017827:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003619968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.017834:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1789896068.017840:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003619968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.017873:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.017919:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.017936:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.017940:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620096 00000100:00100000:1.0:1789896068.017946:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620096 00000100:00100000:1.0:1789896068.017976:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:1.0:1789896068.017985:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003620096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.018063:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003620096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.018070:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1789896068.018071:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.018247:0:216557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216557:1876838003620224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.018295:0:216557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.018335:0:216557:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d450c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896068.018346:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620224 00000100:00100000:3.0:1789896068.018350:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620224 00000100:00100000:3.0:1789896068.018517:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:3.0:1789896068.018527:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:216557:x1876838003620224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896068.018623:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:216557:x1876838003620224:12345-0@lo:502:llog_process_th.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.018632:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:1.0:1789896068.018635:0:216557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216557:1876838003620224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896068.018668:0:216557:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896068.018674:0:216557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896068.018682:0:216557:0:(obd_config.c:1561:class_process_config()) marker 206 (0x1) lustre quota.ost 00000020:00000080:1.0:1789896068.018687:0:216557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789896068.018709:0:216557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216557:1876838003620352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.018746:0:216557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.018781:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620352 00000100:00100000:1.0:1789896068.018781:0:216557:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5468d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896068.018787:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620352 00000100:00100000:3.0:1789896068.018821:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:3.0:1789896068.018832:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:216557:x1876838003620352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896068.018906:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:216557:x1876838003620352:12345-0@lo:502:llog_process_th.0 Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.018914:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:1.0:1789896068.018917:0:216557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216557:1876838003620352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896068.018941:0:216557:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896068.018946:0:216557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896068.018948:0:216557:0:(obd_config.c:1561:class_process_config()) marker 206 (0x2) lustre quota.ost 00000040:00080000:1.0:1789896068.018952:0:216557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 44 count 44 00000020:01000000:3.0:1789896068.018994:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-43 (rc=0) 10000000:01000000:3.0:1789896068.019018:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789896068.019024:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.019033:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896068.019040:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896068.019042:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 190 10000000:01000000:3.0:1789896068.019045:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896068.019058:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.019066:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.019074:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.019093:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.019115:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.019131:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.019139:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620480 00000100:00100000:1.0:1789896068.019144:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620480 00000100:00100000:1.0:1789896068.019173:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:1.0:1789896068.019183:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003620480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.019190:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896068.019216:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28df expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.019232:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28df expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.019242:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28df expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.019249:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6400, rc 0) 00000100:00100000:1.0:1789896068.019283:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003620480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.019291:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:3.0:1789896068.019301:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896068.019317:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.019325:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.019362:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.019386:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.019409:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620608 00000100:00100000:3.0:1789896068.019413:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.019420:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620608 00000100:00100000:1.0:1789896068.019448:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:1.0:1789896068.019458:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003620608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.019535:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003620608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.019544:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.019544:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:3.0:1789896068.019579:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.019612:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.019627:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.019632:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620736 00000100:00100000:1.0:1789896068.019636:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620736 00000100:00100000:1.0:1789896068.019662:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:1.0:1789896068.019671:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003620736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.019740:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003620736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.019747:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.019750:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000040:00080000:1.0:1789896068.020418:0:216558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789896068.020482:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789896068.020507:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896068.020512:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.020520:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896068.020533:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789896068.020535:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 215 10000000:01000000:3.0:1789896068.020537:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789896068.020551:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.020557:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.020564:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.020575:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.020600:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.020625:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620864 00000100:00100000:1.0:1789896068.020631:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620864 00000100:00100000:3.0:1789896068.020632:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.020661:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:1.0:1789896068.020670:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003620864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.020677:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896068.020684:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28ed expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.020699:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.020708:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.020726:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6600, rc 0) 00000100:00100000:1.0:1789896068.020775:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003620864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.020782:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:0.0:1789896068.020800:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896068.020814:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.020823:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.020866:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.020907:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.020921:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.020926:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003620992 00000100:00100000:1.0:1789896068.020929:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003620992 00000100:00100000:1.0:1789896068.020950:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:1.0:1789896068.020954:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003620992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.021026:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003620992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.021034:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1789896068.021049:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003620992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.021074:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896068.021107:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.021122:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.021128:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621120 00000100:00100000:1.0:1789896068.021133:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621120 00000100:00100000:1.0:1789896068.021162:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:1.0:1789896068.021170:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003621120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.021269:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003621120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.021277:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:2.0:1789896068.021287:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.021475:0:216559:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216559:1876838003621248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.021511:0:216559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.021539:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621248 00000100:00100000:1.0:1789896068.021541:0:216559:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1789896068.021546:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621248 00000100:00100000:3.0:1789896068.021580:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:3.0:1789896068.021589:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216559:x1876838003621248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896068.021674:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216559:x1876838003621248:12345-0@lo:502:llog_process_th.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.021683:0:216559:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216559:1876838003621248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896068.021684:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000020:01000000:1.0:1789896068.021711:0:216559:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896068.021717:0:216559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896068.021723:0:216559:0:(obd_config.c:1561:class_process_config()) marker 203 (0x1) lustre quota.ost 00000020:00000080:1.0:1789896068.021729:0:216559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789896068.021749:0:216559:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216559:1876838003621376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.021792:0:216559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.021809:0:216559:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896068.021820:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621376 00000100:00100000:2.0:1789896068.021825:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621376 00000100:00100000:2.0:1789896068.021854:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1789896068.021863:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216559:x1876838003621376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896068.021944:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216559:x1876838003621376:12345-0@lo:502:llog_process_th.0 Request processed in 82us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.021951:0:216559:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216559:1876838003621376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896068.021953:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000020:01000000:1.0:1789896068.021977:0:216559:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896068.021982:0:216559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896068.021984:0:216559:0:(obd_config.c:1561:class_process_config()) marker 203 (0x2) lustre quota.ost 00000040:00080000:1.0:1789896068.021988:0:216559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 218 count 214 00000020:01000000:2.0:1789896068.022034:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 215-217 (rc=0) 10000000:01000000:2.0:1789896068.022060:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896068.022066:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022073:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896068.022080:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896068.022081:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 190 10000000:01000000:2.0:1789896068.022084:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896068.022097:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022104:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022112:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.022133:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.022160:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.022179:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621504 00000100:00100000:2.0:1789896068.022180:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896068.022184:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621504 00000100:00100000:2.0:1789896068.022238:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1789896068.022250:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003621504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896068.022258:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896068.022269:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a28fb expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022284:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022294:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022300:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9000, rc 0) 00000100:00100000:2.0:1789896068.022337:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003621504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.022343:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1789896068.022383:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896068.022397:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.022405:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.022453:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.022480:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.022507:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621632 00000100:00100000:2.0:1789896068.022511:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621632 00000100:00100000:2.0:1789896068.022540:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:2.0:1789896068.022546:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003621632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.022607:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003621632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.022614:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000100:00100000:2.0:1789896068.022856:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896068.022871:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.022897:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.022933:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.022952:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.022959:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621760 00000100:00100000:1.0:1789896068.022964:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621760 00000100:00100000:1.0:1789896068.022995:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:1.0:1789896068.023005:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003621760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.023073:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003621760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.023080:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.023084:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000040:00080000:2.0:1789896068.023737:0:216561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789896068.023817:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789896068.023849:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896068.023856:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.023869:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896068.023878:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789896068.023879:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 215 10000000:01000000:3.0:1789896068.023882:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896068.023897:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.023905:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.023912:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.023925:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.023952:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.023982:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003621888 00000100:00100000:3.0:1789896068.023984:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896068.023987:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003621888 00000100:00100000:2.0:1789896068.024018:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:2.0:1789896068.024028:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003621888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896068.024037:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896068.024046:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2909 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.024073:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.024082:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.024089:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896068.024122:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003621888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.024129:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:3.0:1789896068.024151:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003621888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896068.024163:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.024172:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.024238:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.024265:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.024294:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622016 00000100:00100000:3.0:1789896068.024297:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.024300:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622016 00000100:00100000:1.0:1789896068.024325:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:1.0:1789896068.024332:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003622016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896068.024409:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003622016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.024416:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1789896068.024423:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.024453:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.024485:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.024503:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896068.024520:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622144 00000100:00100000:2.0:1789896068.024525:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622144 00000100:00100000:2.0:1789896068.024551:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1789896068.024559:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003622144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.024628:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003622144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.024635:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:3.0:1789896068.024653:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.024992:0:216562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216562:1876838003622272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896068.025024:0:216562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.025047:0:216562:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10180 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.025066:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622272 00000100:00100000:1.0:1789896068.025071:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622272 00000100:00100000:1.0:1789896068.025097:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:1.0:1789896068.025104:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216562:x1876838003622272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896068.025223:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216562:x1876838003622272:12345-0@lo:502:llog_process_th.0 Request processed in 119us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.025233:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1789896068.025258:0:216562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216562:1876838003622272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896068.025287:0:216562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789896068.025294:0:216562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896068.025296:0:216562:0:(obd_config.c:1561:class_process_config()) marker 204 (0x1) lustre quota.ost 00000020:00000080:3.0:1789896068.025302:0:216562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789896068.025323:0:216562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216562:1876838003622400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896068.025359:0:216562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.025386:0:216562:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74d51600 going to sleep for 11 seconds 00000100:00100000:2.0:1789896068.025452:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622400 00000100:00100000:2.0:1789896068.025457:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622400 00000100:00100000:2.0:1789896068.025487:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:2.0:1789896068.025497:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216562:x1876838003622400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896068.025574:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216562:x1876838003622400:12345-0@lo:502:llog_process_th.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.025582:0:216562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216562:1876838003622400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896068.025584:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000020:01000000:3.0:1789896068.025608:0:216562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896068.025613:0:216562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896068.025615:0:216562:0:(obd_config.c:1561:class_process_config()) marker 204 (0x2) lustre quota.ost 00000040:00080000:3.0:1789896068.025628:0:216562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 218 count 214 00000020:01000000:2.0:1789896068.026600:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 215-217 (rc=0) 10000000:01000000:2.0:1789896068.026621:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896068.026631:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.026638:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896068.026643:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896068.026644:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896068.026646:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896068.026660:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.026665:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.026670:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.026680:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.026704:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.026731:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947900 going to sleep for 11 seconds 00000100:00100000:1.0:1789896068.026739:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622528 00000100:00100000:1.0:1789896068.026744:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622528 00000100:00100000:1.0:1789896068.026782:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:1.0:1789896068.026790:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003622528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896068.026799:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896068.026810:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2917 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.026828:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.026837:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.026842:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7400, rc 0) 00000100:00100000:1.0:1789896068.026882:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003622528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.026890:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1789896068.026909:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896068.026922:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.026930:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.026977:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.027014:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.027035:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947900 going to sleep for 11 seconds 00000100:00100000:3.0:1789896068.027053:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622656 00000100:00100000:3.0:1789896068.027057:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622656 00000100:00100000:3.0:1789896068.027087:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:3.0:1789896068.027092:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003622656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896068.027150:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003622656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (135us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896068.027156:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1789896068.027163:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003622656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789896068.027189:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896068.027194:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.027218:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.029778:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896068.029813:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970432 00000100:00100000:0.0:1789896068.029821:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970432 00000100:00080000:1.0:1789896068.029880:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896068.029890:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2816 00000100:00100000:0.0:1789896068.029903:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:215517:x1876838015970432:12345-192.168.202.44@tcp:48:lfs.0 00000001:00080000:3.0:1789896068.031085:0:188711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904343 is committed 00010000:00010000:2.0:1789896068.031117:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031128:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031136:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031143:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6800 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896068.031148:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031156:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031175:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff91aa65643f00) 00010000:00010000:2.0:1789896068.031178:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896068.031183:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031219:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c6800/0x412fd4b3617a2861 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031249:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031256:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031263:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031269:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7a00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896068.031272:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031279:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031290:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff91aa65643600) 00010000:00010000:2.0:1789896068.031293:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896068.031296:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031301:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7a00/0x412fd4b3617a2868 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213600 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031315:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031321:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031333:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031339:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2200 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896068.031342:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031348:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031356:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff91aa65643600) 00010000:00010000:2.0:1789896068.031359:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789896068.031362:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.031367:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2200/0x412fd4b3617a2899 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.031944:0:190608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003622784:0@lo:106: 00000100:00100000:0.0:1789896068.031983:0:190608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.032021:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622784 00000100:00100000:0.0:1789896068.032023:0:190608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003622912:0@lo:106: 00000100:00100000:2.0:1789896068.032027:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622784 00000100:00100000:0.0:1789896068.032058:0:190608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.032081:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789896068.032087:0:189482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:2.0:1789896068.032094:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003622912 00000100:00100000:0.0:1789896068.032095:0:190608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003623040:0@lo:106: 00000100:00100000:2.0:1789896068.032099:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003622912 00000100:00100000:3.0:1789896068.032103:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789896068.032113:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:190608:x1876838003622784:12345-0@lo:106: 00010000:00010000:3.0:1789896068.032122:0:189482:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.032130:0:189482:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.032133:0:190608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.032137:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1789896068.032149:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:190608:x1876838003622912:12345-0@lo:106: 00000100:00100000:0.0:1789896068.032157:0:190608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003623168:0@lo:106: 00010000:00010000:2.0:1789896068.032159:0:188714:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.032168:0:188714:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.032192:0:190608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.032224:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:190608:x1876838003622784:12345-0@lo:106: Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.032234:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1789896068.032246:0:190608:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9531516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896068.032255:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:190608:x1876838003622912:12345-0@lo:106: Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.032256:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003623040 00000100:00100000:3.0:1789896068.032262:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003623040 00000100:00100000:2.0:1789896068.032266:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1789896068.032273:0:190608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003622784:0@lo:106: 00000100:00100000:3.0:1789896068.032289:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003623168 00000100:00100000:0.0:1789896068.032293:0:190608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003622912:0@lo:106: 00000100:00100000:3.0:1789896068.032294:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003623168 00000100:00100000:2.0:1789896068.032313:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789896068.032326:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1789896068.032326:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:190608:x1876838003623040:12345-0@lo:106: 00010000:00010000:2.0:1789896068.032337:0:188714:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.032343:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:190608:x1876838003623168:12345-0@lo:106: 00010000:00010000:2.0:1789896068.032346:0:188714:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.032355:0:189482:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.032365:0:189482:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.032384:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:190608:x1876838003623040:12345-0@lo:106: Request processed in 63us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.032389:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789896068.032435:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:190608:x1876838003623168:12345-0@lo:106: Request processed in 97us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.032442:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1789896068.032674:0:190608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003623040:0@lo:106: 00000100:00100000:0.0:1789896068.032682:0:190608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:190608:1876838003623168:0@lo:106: 00000100:00100000:0.0:1789896068.032766:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215517:x1876838015970432:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 2857us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.032774:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2816 00010000:00010000:1.0:1789896068.076358:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896068.275400:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896068.275764:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970560 00000100:00100000:2.0:1789896068.275775:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970560 00000100:00100000:2.0:1789896068.275831:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2478 00000100:00100000:2.0:1789896068.275843:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015970560:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896068.275860:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896068.275879:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f6a2 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.275907:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.275919:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.275936:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896068.275995:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015970560:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 154us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.276003:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2478 00000100:00100000:3.0:1789896068.276668:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896068.276713:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970688 00000100:00100000:2.0:1789896068.276719:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970688 00000100:00100000:2.0:1789896068.276749:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2479 00000100:00100000:2.0:1789896068.276769:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015970688:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.276886:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015970688:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 130us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.276893:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2479 00000100:00100000:1.0:1789896068.277558:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896068.277595:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970816 00000100:00100000:2.0:1789896068.277599:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970816 00000100:00100000:2.0:1789896068.277625:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2480 00000100:00100000:2.0:1789896068.277631:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015970816:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.277706:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015970816:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.277714:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2480 00000100:00100000:0.0:1789896068.279284:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896068.279338:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015970944 00000100:00100000:2.0:1789896068.279343:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015970944 00000100:00100000:2.0:1789896068.279376:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2481 00000100:00100000:2.0:1789896068.279384:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015970944:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896068.279396:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896068.279412:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f6a9 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.279442:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.279454:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.279463:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9a00, rc 0) 00000100:00100000:2.0:1789896068.279500:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015970944:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 117us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.279507:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2481 00000100:00100000:1.0:1789896068.280063:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896068.280098:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971072 00000100:00100000:2.0:1789896068.280103:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971072 00000100:00100000:2.0:1789896068.280133:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2482 00000100:00100000:2.0:1789896068.280142:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015971072:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896068.280224:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015971072:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 84us (161us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896068.280233:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2482 00000020:00000080:2.0:1789896068.324444:0:216607:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff113c1fe0 20000000:00000080:2.0:1789896068.324457:0:216607:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a94f46f800 uarg=0000000000000000 00000040:00100000:2.0:1789896068.324926:0:216607:0:(llog.c:1072:llog_reverse_process()) index 189 : idx 181 20000000:01000000:2.0:1789896068.324931:0:216607:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 182 cmd:0xce023 lustre.qpool1 00000040:00080000:2.0:1789896068.325000:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].190, 224 off42864 20000000:01000000:2.0:1789896068.325015:0:216607:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789896068.325024:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].191, 104 off42968 00000040:00080000:2.0:1789896068.325032:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].192, 224 off43192 00000040:00080000:2.0:1789896068.325070:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].218, 224 off48224 20000000:01000000:2.0:1789896068.325079:0:216607:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789896068.325103:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].219, 112 off48336 00000040:00080000:2.0:1789896068.325121:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].220, 224 off48560 00000040:00080000:2.0:1789896068.325166:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].218, 224 off48224 20000000:01000000:2.0:1789896068.325171:0:216607:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789896068.325178:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].219, 112 off48336 00000040:00080000:2.0:1789896068.325186:0:216607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].220, 224 off48560 10000000:01000000:2.0:1789896068.325192:0:216607:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896068.325351:0:216607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325366:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325371:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325376:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325379:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325383:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28df expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325387:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325393:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325398:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325411:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325420:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325428:0:216607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325436:0:216607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325470:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325480:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 9 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.325492:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623296:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896068.325566:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325572:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 9 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.325578:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623424:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896068.325597:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325610:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 23 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.325617:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623552:0@lo:104: 00000100:00100000:2.0:1789896068.325645:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896068.325675:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325683:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 23 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.325685:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003623552 00000100:00100000:2.0:1789896068.325691:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623680:0@lo:104: 00000100:00100000:0.0:1789896068.325693:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003623552 00000100:00100000:2.0:1789896068.325710:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896068.325739:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.325746:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003623680 00010000:00010000:2.0:1789896068.325747:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 23 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.325752:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1789896068.325765:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003623680 00000100:00100000:2.0:1789896068.325768:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623808:0@lo:104: 00000100:00100000:0.0:1789896068.325772:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216607:x1876838003623552:12345-0@lo:104: 00010000:00010000:0.0:1789896068.325787:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.325795:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896068.325806:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003623808 00000100:00100000:1.0:1789896068.325810:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003623808 00010000:00010000:2.0:1789896068.325816:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325825:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 23 pid: 188726 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.325829:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00010000:00010000:0.0:1789896068.325837:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896068.325840:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1789896068.325841:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623936:0@lo:104: 00000100:00100000:3.0:1789896068.325847:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623680:12345-0@lo:104: 00000100:00100000:0.0:1789896068.325848:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623552:12345-0@lo:104: Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.325855:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623808:12345-0@lo:104: 00010000:00010000:3.0:1789896068.325865:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.325866:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00010000:00010000:1.0:1789896068.325868:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.325876:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896068.325884:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003623936 00000100:00100000:0.0:1789896068.325889:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003623936 00010000:00010000:2.0:1789896068.325897:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28df expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.325906:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28df expref: 23 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.325914:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624064:0@lo:104: 00000100:00100000:0.0:1789896068.325917:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1789896068.325923:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94f46c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623936:12345-0@lo:104: 00010000:00010000:0.0:1789896068.325931:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.325940:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896068.325950:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623680:12345-0@lo:104: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.325950:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896068.325951:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789896068.325962:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623808:12345-0@lo:104: Request processed in 111us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.325965:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:0.0:1789896068.325967:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1789896068.325972:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.325977:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94f46c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216607:x1876838003623936:12345-0@lo:104: Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896068.325980:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00010000:00010000:2.0:1789896068.325984:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 23 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.325986:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624064 00000100:00100000:3.0:1789896068.325993:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624064 00000100:00100000:0.0:1789896068.325994:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1789896068.325997:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624192:0@lo:104: 00000100:00100000:2.0:1789896068.326021:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.326030:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00010000:00010000:1.0:1789896068.326033:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789896068.326036:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624192 00010000:00010000:1.0:1789896068.326040:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.326041:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624192 00010000:00010000:2.0:1789896068.326046:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326058:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8a00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896068.326062:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 23 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896068.326064:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326081:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624320:0@lo:104: 00010000:00010000:1.0:1789896068.326084:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896068.326093:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896068.326104:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896068.326109:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.326110:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624064:12345-0@lo:104: 00000100:00100000:0.0:1789896068.326111:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00010000:00010000:3.0:1789896068.326122:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.326124:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624192:12345-0@lo:104: 00010000:00010000:0.0:1789896068.326138:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326147:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326155:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326158:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896068.326166:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 23 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.326169:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789896068.326177:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789896068.326180:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624064:12345-0@lo:104: Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.326186:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624192:12345-0@lo:104: Request processed in 63us (162us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896068.326191:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326221:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624576:0@lo:104: 00000100:00100000:3.0:1789896068.326223:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1789896068.326233:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:1.0:1789896068.326237:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a291e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326243:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624320 00000100:00100000:3.0:1789896068.326248:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624320 00000100:00100000:2.0:1789896068.326253:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896068.326255:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789896068.326256:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789896068.326261:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326263:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326279:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2600 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:3.0:1789896068.326282:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624576 00010000:00010000:0.0:1789896068.326282:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8600 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896068.326284:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326287:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624576 10000000:00010000:0.0:1789896068.326289:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326290:0:216607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326306:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00010000:00010000:1.0:1789896068.326306:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326307:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326308:0:216607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 23 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326320:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624320:12345-0@lo:104: 10000000:00010000:1.0:1789896068.326333:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326334:0:216607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624704:0@lo:104: 10000000:00010000:0.0:1789896068.326334:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.326336:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896068.326356:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789896068.326356:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896068.326362:0:216607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896068.326390:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789896068.326393:0:216607:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5009b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789896068.326396:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624320:12345-0@lo:104: Request processed in 80us (294us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896068.326396:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326405:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326411:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789896068.326418:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623552:0@lo:104: 00010000:00010000:1.0:1789896068.326418:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896068.326420:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896068.326430:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624704 00000100:00100000:2.0:1789896068.326434:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623680:0@lo:104: 00000100:00100000:3.0:1789896068.326436:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624704 00010000:00010000:0.0:1789896068.326440:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326441:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326446:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623808:0@lo:104: 00010000:00010000:0.0:1789896068.326458:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a28fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2902 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326459:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1789896068.326460:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623936:0@lo:104: 00010000:00010000:1.0:1789896068.326462:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a2909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2910 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326473:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624064:0@lo:104: 00000100:00100000:3.0:1789896068.326475:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624576:12345-0@lo:104: 00010000:00010000:0.0:1789896068.326478:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789896068.326483:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326485:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624192:0@lo:104: 00010000:00010000:3.0:1789896068.326488:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326497:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624320:0@lo:104: 00010000:00010000:0.0:1789896068.326502:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896068.326507:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326515:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789896068.326516:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326521:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896068.326528:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326530:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789896068.326531:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2e00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896068.326535:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896068.326538:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896068.326538:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896068.326547:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3000 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896068.326552:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326556:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896068.326565:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326567:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326574:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326586:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1789896068.326587:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789896068.326588:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326596:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896068.326597:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896068.326603:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a28ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28f4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326611:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.326613:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789896068.326614:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896068.326617:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326620:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326629:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216607:x1876838003624576:12345-0@lo:104: Request processed in 159us (377us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896068.326633:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896068.326636:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896068.326639:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6000 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896068.326643:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326646:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896068.326646:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326648:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00010000:00010000:1.0:1789896068.326668:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a28df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28e6 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326669:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00010000:00010000:2.0:1789896068.326669:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a28d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28d8 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326669:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326684:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216607:x1876838003624704:12345-0@lo:104: 10000000:00010000:0.0:1789896068.326691:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326693:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896068.326697:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896068.326698:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326700:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.326701:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896068.326705:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789896068.326707:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896068.326712:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896068.326722:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326735:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624576:0@lo:104: 00010000:00010000:0.0:1789896068.326742:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896068.326744:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ae00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896068.326751:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326752:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003624704:0@lo:104: 10000000:00010000:1.0:1789896068.326753:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.326766:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789896068.326781:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216607:x1876838003624704:12345-0@lo:104: Request processed in 100us (420us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896068.326783:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326797:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa7714a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003624832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896068.326798:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00010000:00010000:0.0:1789896068.326804:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a28c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896068.326807:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896068.326819:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896068.326823:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896068.326828:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326833:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896068.326835:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3e00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896068.326837:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896068.326839:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326853:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896068.326854:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003625344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.326857:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326862:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896068.326866:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.326871:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a28b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896068.326877:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896068.326884:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896068.326886:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896068.326891:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896068.326896:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896068.326900:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896068.326901:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326909:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896068.326910:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896068.326912:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624832 00010000:00010000:0.0:1789896068.326916:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.326918:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624832 00000100:00100000:2.0:1789896068.326920:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789896068.326925:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003624448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.326928:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a28a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a28ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.326930:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003624960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896068.326942:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 24 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.326945:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896068.326953:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896068.326955:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896068.326971:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625344 00000100:00100000:1.0:1789896068.326971:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896068.326976:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625344 00000100:00100000:2.0:1789896068.326986:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623296:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896068.326991:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 25 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.327002:0:216607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216607:1876838003623424:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896068.327009:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896068.327014:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624448 00000100:00100000:0.0:1789896068.327019:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624448 00000100:00100000:3.0:1789896068.327021:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1789896068.327035:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3615:x1876838003624832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327041:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 26 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896068.327060:0:216607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.327064:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625216 00000100:00100000:0.0:1789896068.327068:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625216 00000100:00100000:1.0:1789896068.327071:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327084:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28df expref: 27 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.327092:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1789896068.327098:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.327103:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003625344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896068.327103:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625728 00000100:00100000:0.0:1789896068.327107:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625728 00010000:00010000:2.0:1789896068.327113:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896068.327115:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:0.0:1789896068.327119:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 28 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.327121:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 28 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327125:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896068.327126:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896068.327136:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00010000:00010000:2.0:1789896068.327137:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 28 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.327143:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3618:x1876838003624448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896068.327151:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6a00/0x412fd4b3617a28d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28d1 expref: 28 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327152:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896068.327159:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 28 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327160:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896068.327171:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896068.327172:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 27 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327174:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 27 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327179:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896068.327196:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 27 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.327227:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003625344:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (341us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896068.327227:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7400/0x412fd4b3617a291e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2917 expref: 27 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327231:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2909 expref: 27 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327241:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896068.327242:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00010000:00010000:0.0:1789896068.327246:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896068.327253:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896068.327266:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625088 00000100:00100000:2.0:1789896068.327271:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625088 00010000:00010000:2.0:1789896068.327287:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 25 pid: 188726 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327292:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003624448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896068.327294:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003624448:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.327297:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003624832:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.327305:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625600 00000100:00100000:3.0:1789896068.327308:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1789896068.327313:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625600 00000100:00100000:0.0:1789896068.327323:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1789896068.327326:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896068.327331:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 25 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.327334:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1789896068.327343:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003624960 00000100:00100000:3.0:1789896068.327348:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003625216:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896068.327349:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003625472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896068.327349:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003624960 00000100:00100000:2.0:1789896068.327356:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00010000:00010000:3.0:1789896068.327360:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896068.327365:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003625728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327366:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 25 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327368:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28df expref: 25 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.327377:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896068.327386:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896068.327387:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 25 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327390:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28df expref: 25 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.327394:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1789896068.327405:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa7714a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003624832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896068.327407:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003625088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896068.327411:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 25 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327416:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896068.327417:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003625344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327422:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 25 pid: 188726 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327425:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a28e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28df expref: 25 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.327430:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a28ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28a7 expref: 25 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327442:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 25 pid: 188726 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327449:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896068.327452:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896068.327453:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6600/0x412fd4b3617a28f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28ed expref: 23 pid: 188726 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327462:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896068.327503:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003625216:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.327507:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003625728:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.327507:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003625088:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.327513:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1789896068.327516:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896068.327524:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1789896068.327529:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1789896068.327531:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625472 00000100:00100000:3.0:1789896068.327535:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625472 00000100:00100000:2.0:1789896068.327543:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971328 00010000:00010000:3.0:1789896068.327549:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 20 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.327549:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971328 00000100:00100000:0.0:1789896068.327550:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1789896068.327554:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896068.327562:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3618:x1876838003625600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896068.327568:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 10 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327571:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896068.327572:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971200 00010000:00010000:0.0:1789896068.327577:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 20 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.327578:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971200 00000100:00100000:1.0:1789896068.327582:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00010000:00010000:3.0:1789896068.327593:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 11 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327600:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003624960:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896068.327603:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1789896068.327614:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003625472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327614:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 20 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.327617:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896068.327623:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896068.327628:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 20 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.327629:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 592 00010000:00010000:2.0:1789896068.327632:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 20 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327632:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a28bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28b5 expref: 20 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.327644:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015971328:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789896068.327654:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 19 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327658:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896068.327672:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 11 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327675:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896068.327680:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 19 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.327697:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28fb expref: 19 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.327700:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 11 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896068.327704:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3618:x1876838003625600:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.327722:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00010000:00010000:2.0:1789896068.327727:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a28ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a28c3 expref: 18 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896068.327733:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896068.327734:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a292c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a9 expref: 11 pid: 188723 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896068.327737:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896068.327740:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 593 00010000:00010000:3.0:1789896068.327749:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896068.327750:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015971200:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327774:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896068.327780:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 10 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327791:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 10 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327796:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003624960:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896068.327799:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003625472:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896068.327802:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015971328:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 156us (286us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896068.327811:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6a2 expref: 10 pid: 188725 timeout: 4040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327818:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1789896068.327826:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00010000:00010000:0.0:1789896068.327829:0:188716:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896068.327835:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 592 00010000:00010000:0.0:1789896068.327843:0:188716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327866:0:188716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327874:0:188716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327881:0:188716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896068.327888:0:188716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327889:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003624960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896068.327897:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327901:0:188716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8200 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:0.0:1789896068.327906:0:188716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896068.327913:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003625472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327915:0:188716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.327916:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896068.327933:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327938:0:188716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896068.327942:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003625728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896068.327947:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896068.327975:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+8:2403:x1876838015971200:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 225us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896068.327983:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 593 00010000:00010000:3.0:1789896068.328007:0:216607:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.328016:0:216607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896068.328021:0:216607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2933 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896069.036410:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003625856:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896069.036410:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876838003626112:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896069.036417:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876838003626240:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896069.036446:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003626368:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896069.036491:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.036497:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.036525:0:189381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626240 00000100:00100000:3.0:1789896069.036531:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.036536:0:189381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626240 00000100:00100000:2.0:1789896069.036559:0:188733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626368 00000100:00100000:3.0:1789896069.036563:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003625984:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896069.036566:0:188733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626368 00000100:00100000:1.0:1789896069.036573:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.036600:0:189381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625856 00000100:00100000:3.0:1789896069.036602:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.036603:0:188733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626112 00000100:00100000:1.0:1789896069.036603:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789896069.036605:0:189381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625856 00000100:00100000:2.0:1789896069.036608:0:188733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626112 00000100:00100000:1.0:1789896069.036616:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003626496:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896069.036631:0:189381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003625984 00000100:00100000:0.0:1789896069.036635:0:189381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003625984 00000100:00100000:2.0:1789896069.036640:0:188733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789896069.036648:0:193050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789896069.036654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.036655:0:188733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+12:3617:x1876838003626240:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896069.036659:0:193050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3618:x1876838003626368:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896069.036662:0:189381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626496 00000100:00100000:0.0:1789896069.036667:0:189381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626496 00000100:00100000:0.0:1789896069.036688:0:189381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789896069.036699:0:188734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789896069.036700:0:189381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+13:3615:x1876838003625856:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896069.036712:0:188734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ea7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+13:3616:x1876838003626112:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896069.036729:0:188733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+13:3617:x1876838003626240:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.036737:0:193050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3618:x1876838003626368:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.036762:0:188733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789896069.036777:0:189381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3615:x1876838003625856:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.036781:0:193050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789896069.036791:0:188733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789896069.036795:0:188734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ea7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+13:3616:x1876838003626112:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896069.036799:0:189381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789896069.036804:0:188733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+12:3615:x1876838003625984:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896069.036809:0:193050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789896069.036818:0:188734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789896069.036824:0:193050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003626496:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896069.036868:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003625856:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896069.036878:0:188733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003625984:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.036884:0:193050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003626496:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.036888:0:188733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789896069.036893:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003625984:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896069.036894:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876838003626240:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896069.036901:0:193050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789896069.036943:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003626496:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896069.036945:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003626368:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789896069.036964:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876838003626112:0@lo:601:lquota_wb_lustr.0 00010000:00010000:1.0:1789896069.100385:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896069.555699:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.555770:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971456 00000100:00100000:2.0:1789896069.555778:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971456 00000100:00100000:2.0:1789896069.555827:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2483 00000100:00100000:2.0:1789896069.555834:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015971456:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896069.555848:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896069.555864:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f6b0 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.555885:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.555894:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.555900:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896069.555944:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015971456:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 112us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.555949:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2483 00000100:00100000:1.0:1789896069.556680:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.556722:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971584 00000100:00100000:2.0:1789896069.556726:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971584 00000100:00100000:2.0:1789896069.556758:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2484 00000100:00100000:2.0:1789896069.556764:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015971584:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.556861:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015971584:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.556866:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2484 00000100:00100000:3.0:1789896069.557401:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.557436:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971712 00000100:00100000:2.0:1789896069.557439:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971712 00000100:00100000:2.0:1789896069.557463:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2485 00000100:00100000:2.0:1789896069.557469:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015971712:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.557540:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015971712:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.557548:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2485 00000100:00100000:0.0:1789896069.558439:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.558475:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971840 00000100:00100000:2.0:1789896069.558479:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971840 00000100:00100000:2.0:1789896069.558505:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2486 00000100:00100000:2.0:1789896069.558512:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:215538:x1876838015971840:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896069.558594:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:215538:x1876838015971840:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 81us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.558601:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2486 00000100:00100000:1.0:1789896069.559289:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.559334:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015971968 00000100:00100000:2.0:1789896069.559339:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015971968 00000100:00100000:2.0:1789896069.559366:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2487 00000100:00100000:2.0:1789896069.559374:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:215538:x1876838015971968:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896069.559455:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:215538:x1876838015971968:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.559462:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2487 00000100:00100000:3.0:1789896069.560311:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.560401:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972096 00000100:00100000:2.0:1789896069.560405:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972096 00000100:00100000:2.0:1789896069.560435:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2488 00000100:00100000:2.0:1789896069.560443:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015972096:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896069.560453:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896069.560468:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f6b7 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.560495:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.560505:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.560514:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8200, rc 0) 00000100:00100000:2.0:1789896069.560543:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015972096:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.560550:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2488 00000100:00100000:0.0:1789896069.561241:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896069.561274:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972224 00000100:00100000:2.0:1789896069.561279:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972224 00000100:00100000:2.0:1789896069.561306:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2489 00000100:00100000:2.0:1789896069.561315:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015972224:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.561374:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015972224:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 60us (133us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896069.561389:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2489 10000000:01000000:0.0:1789896069.740311:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896069.740317:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 190 10000000:01000000:0.0:1789896069.740321:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896069.740364:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.740373:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.740383:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.740410:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003626624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.740490:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.740536:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.740564:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626624 00000100:00100000:2.0:1789896069.740574:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626624 00000100:00100000:2.0:1789896069.740629:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1789896069.740638:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003626624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896069.740651:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896069.740667:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2948 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.740692:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.740703:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.740714:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9a00, rc 0) 00000100:00100000:2.0:1789896069.740779:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003626624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.740786:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:0.0:1789896069.740811:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003626624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.740828:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.740837:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.740894:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003626752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.740916:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.740930:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.740957:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626752 00000100:00100000:2.0:1789896069.740962:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626752 00000100:00100000:2.0:1789896069.740991:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1789896069.740998:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003626752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.741104:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003626752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.741111:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:0.0:1789896069.741139:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003626752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.741167:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003626880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.741223:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.741246:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.741271:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003626880 00000100:00100000:2.0:1789896069.741281:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003626880 00000100:00100000:2.0:1789896069.741313:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:2.0:1789896069.741320:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003626880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.741410:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003626880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.741418:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:0.0:1789896069.741499:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003626880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.741848:0:216608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216608:1876838003627008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.741881:0:216608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.741897:0:216608:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7ff4db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.741914:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627008 00000100:00100000:1.0:1789896069.741919:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627008 00000100:00100000:1.0:1789896069.741945:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:1.0:1789896069.741950:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216608:x1876838003627008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896069.742055:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216608:x1876838003627008:12345-0@lo:502:llog_process_th.0 Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.742061:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:2.0:1789896069.742092:0:216608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216608:1876838003627008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.742135:0:216608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216608:1876838003627136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.742164:0:216608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.742184:0:216608:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5930ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.742219:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627136 00000100:00100000:3.0:1789896069.742224:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627136 00000100:00100000:3.0:1789896069.742252:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:3.0:1789896069.742261:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216608:x1876838003627136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.742328:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216608:x1876838003627136:12345-0@lo:502:llog_process_th.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.742332:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:2.0:1789896069.742398:0:216608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216608:1876838003627136:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896069.742418:0:216608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:0.0:1789896069.742501:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:0.0:1789896069.742521:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896069.742528:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.742538:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.742545:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789896069.742553:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 41 10000000:01000000:0.0:1789896069.742556:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896069.742570:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.742577:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.742585:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.742597:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.742623:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.742647:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.742661:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627264 00000100:00100000:1.0:1789896069.742666:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627264 00000100:00100000:1.0:1789896069.742694:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1789896069.742700:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003627264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896069.742706:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896069.742713:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2956 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.742725:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.742732:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.742736:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7a00, rc 0) 00000100:00100000:1.0:1789896069.742773:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003627264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.742777:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1789896069.742807:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.742819:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.742827:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.742862:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.742887:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.742905:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.742936:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627392 00000100:00100000:3.0:1789896069.742941:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627392 00000100:00100000:3.0:1789896069.742968:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:3.0:1789896069.742974:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003627392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.743046:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003627392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.743053:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:0.0:1789896069.743078:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.743104:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.743138:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.743162:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.743181:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627520 00000100:00100000:1.0:1789896069.743185:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627520 00000100:00100000:1.0:1789896069.743234:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:1.0:1789896069.743241:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003627520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896069.743319:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003627520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.743324:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:0.0:1789896069.743343:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789896069.744018:0:216609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 41 00000020:01000000:0.0:1789896069.744106:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 41-40 (rc=0) 10000000:01000000:0.0:1789896069.744121:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789896069.744127:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.744135:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.744141:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896069.744143:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 190 10000000:01000000:0.0:1789896069.744145:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896069.744158:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.744164:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.744172:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.744183:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.744237:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.744262:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627648 00000100:00100000:0.0:1789896069.744265:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.744269:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627648 00000100:00100000:3.0:1789896069.744302:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1789896069.744309:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003627648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896069.744316:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896069.744327:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2964 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.744341:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.744350:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.744358:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2800, rc 0) 00000100:00100000:3.0:1789896069.744399:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003627648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.744405:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:0.0:1789896069.744429:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.744439:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.744452:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.744478:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.744496:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.744510:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.744541:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627776 00000100:00100000:1.0:1789896069.744546:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627776 00000100:00100000:1.0:1789896069.744574:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1789896069.744580:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003627776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896069.744667:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003627776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.744675:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:0.0:1789896069.744685:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.744713:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.744758:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.744774:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.744793:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003627904 00000100:00100000:3.0:1789896069.744799:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003627904 00000100:00100000:3.0:1789896069.744825:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:3.0:1789896069.744831:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003627904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.744897:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003627904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.744905:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:0.0:1789896069.744917:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003627904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.745149:0:216610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216610:1876838003628032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.745180:0:216610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.745225:0:216610:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10000 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.745233:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628032 00000100:00100000:1.0:1789896069.745239:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628032 00000100:00100000:1.0:1789896069.745263:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1789896069.745281:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216610:x1876838003628032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896069.745354:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216610:x1876838003628032:12345-0@lo:502:llog_process_th.0 Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.745359:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:3.0:1789896069.745385:0:216610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216610:1876838003628032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.745421:0:216610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216610:1876838003628160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.745451:0:216610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.745470:0:216610:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.745493:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628160 00000100:00100000:2.0:1789896069.745498:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628160 00000100:00100000:2.0:1789896069.745526:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:2.0:1789896069.745534:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216610:x1876838003628160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.745604:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216610:x1876838003628160:12345-0@lo:502:llog_process_th.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.745610:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:3.0:1789896069.745617:0:216610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216610:1876838003628160:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789896069.745641:0:216610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:0.0:1789896069.745713:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:0.0:1789896069.745727:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896069.745733:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.745755:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.745762:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789896069.745764:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 44 10000000:01000000:0.0:1789896069.745767:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896069.745782:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.745789:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.745803:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.745817:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.745842:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.745860:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.745877:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628288 00000100:00100000:1.0:1789896069.745881:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628288 00000100:00100000:1.0:1789896069.745901:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:1.0:1789896069.745905:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003628288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896069.745910:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896069.745922:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2972 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.745934:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.745940:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.745944:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6800, rc 0) 00000100:00100000:1.0:1789896069.745967:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003628288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.745972:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1789896069.745994:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.746006:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.746013:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.746048:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.746071:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.746088:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.746098:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628416 00000100:00100000:2.0:1789896069.746102:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628416 00000100:00100000:2.0:1789896069.746123:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:2.0:1789896069.746132:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003628416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.746185:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003628416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.746191:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:0.0:1789896069.746238:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.746261:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.746293:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.746316:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.746343:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628544 00000100:00100000:1.0:1789896069.746348:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628544 00000100:00100000:3.0:1789896069.746383:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:3.0:1789896069.746393:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003628544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.746458:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003628544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.746463:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00100000:0.0:1789896069.746494:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789896069.747000:0:216611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 44 00000020:01000000:0.0:1789896069.747051:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 44-43 (rc=0) 10000000:01000000:0.0:1789896069.747066:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789896069.747071:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.747085:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.747092:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896069.747094:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 190 10000000:01000000:0.0:1789896069.747096:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896069.747109:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.747116:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.747123:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.747135:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.747159:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.747177:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c18c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.747217:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628672 00000100:00100000:2.0:1789896069.747222:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628672 00000100:00100000:2.0:1789896069.747256:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:2.0:1789896069.747275:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003628672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896069.747287:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896069.747296:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2980 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.747311:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.747319:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.747326:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896069.747358:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003628672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.747365:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1789896069.747389:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.747401:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.747408:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.747439:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.747463:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.747492:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c18c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.747500:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628800 00000100:00100000:3.0:1789896069.747506:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628800 00000100:00100000:3.0:1789896069.747533:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:3.0:1789896069.747541:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003628800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.747609:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003628800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.747617:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:0.0:1789896069.747628:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.747653:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.747686:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.747702:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c18c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.747722:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003628928 00000100:00100000:2.0:1789896069.747727:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003628928 00000100:00100000:2.0:1789896069.747764:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:2.0:1789896069.747774:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003628928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.747843:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003628928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.747857:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:0.0:1789896069.747863:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003628928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.748074:0:216612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216612:1876838003629056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.748100:0:216612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.748113:0:216612:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50aed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.748133:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629056 00000100:00100000:3.0:1789896069.748138:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629056 00000100:00100000:3.0:1789896069.748164:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:3.0:1789896069.748170:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216612:x1876838003629056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.748281:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216612:x1876838003629056:12345-0@lo:502:llog_process_th.0 Request processed in 109us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.748290:0:216612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216612:1876838003629056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.748304:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:2.0:1789896069.748324:0:216612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216612:1876838003629184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.748354:0:216612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.748375:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629184 00000100:00100000:3.0:1789896069.748380:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629184 00000100:00100000:2.0:1789896069.748390:0:216612:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50aed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.748408:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:3.0:1789896069.748416:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216612:x1876838003629184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.748480:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216612:x1876838003629184:12345-0@lo:502:llog_process_th.0 Request processed in 64us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.748488:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:2.0:1789896069.748497:0:216612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216612:1876838003629184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896069.748515:0:216612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:0.0:1789896069.748570:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:0.0:1789896069.748584:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896069.748590:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.748598:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.748604:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789896069.748606:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 218 10000000:01000000:0.0:1789896069.748608:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896069.748621:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.748628:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.748635:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.748646:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.748669:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.748692:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.748705:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629312 00000100:00100000:3.0:1789896069.748710:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629312 00000100:00100000:3.0:1789896069.748735:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:3.0:1789896069.748753:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003629312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896069.748761:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896069.748770:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a298e expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.748784:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a298e expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.748791:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a298e expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.748797:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2c00, rc 0) 00000100:00100000:3.0:1789896069.748831:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003629312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.748837:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00100000:0.0:1789896069.748861:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.748873:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.748880:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.748913:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.748937:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.748953:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.748956:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629440 00000100:00100000:3.0:1789896069.748966:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629440 00000100:00100000:3.0:1789896069.748997:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:3.0:1789896069.749004:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003629440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.749073:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003629440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.749081:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:0.0:1789896069.749096:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.749119:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.749151:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.749167:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.749171:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629568 00000100:00100000:3.0:1789896069.749175:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629568 00000100:00100000:3.0:1789896069.749216:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:3.0:1789896069.749225:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003629568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.749288:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003629568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.749296:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1789896069.749310:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.749514:0:216613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216613:1876838003629696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.749546:0:216613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.749570:0:216613:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7ffdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.749576:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629696 00000100:00100000:2.0:1789896069.749582:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629696 00000100:00100000:2.0:1789896069.749609:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:2.0:1789896069.749617:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216613:x1876838003629696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.749693:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216613:x1876838003629696:12345-0@lo:502:llog_process_th.0 Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.749699:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:3.0:1789896069.749709:0:216613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216613:1876838003629696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896069.749734:0:216613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789896069.749756:0:216613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896069.749759:0:216613:0:(obd_config.c:1561:class_process_config()) marker 209 (0x1) lustre-MDT0001-m new lustre.qpool1 00000020:00000080:3.0:1789896069.749765:0:216613:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1789896069.749818:0:216613:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00000100:00100000:3.0:1789896069.749838:0:216613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216613:1876838003629824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.749869:0:216613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.749886:0:216613:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7ffdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.749896:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629824 00000100:00100000:2.0:1789896069.749900:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629824 00000100:00100000:2.0:1789896069.749918:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:2.0:1789896069.749922:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216613:x1876838003629824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.749969:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216613:x1876838003629824:12345-0@lo:502:llog_process_th.0 Request processed in 46us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.749974:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:3.0:1789896069.749989:0:216613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216613:1876838003629824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896069.750017:0:216613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896069.750021:0:216613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896069.750023:0:216613:0:(obd_config.c:1561:class_process_config()) marker 209 (0x2) lustre-MDT0001-m new lustre.qpool1 00000040:00080000:3.0:1789896069.750026:0:216613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 221 count 217 00000020:01000000:0.0:1789896069.750086:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 218-220 (rc=0) 10000000:01000000:0.0:1789896069.750101:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789896069.750106:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.750114:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.750121:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896069.750122:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 190 10000000:01000000:0.0:1789896069.750125:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896069.750144:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.750151:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.750158:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.750170:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.750193:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.750234:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c18c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.750238:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003629952 00000100:00100000:2.0:1789896069.750243:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003629952 00000100:00100000:2.0:1789896069.750271:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:2.0:1789896069.750278:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003629952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896069.750284:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896069.750292:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a299c expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.750304:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a299c expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.750310:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a299c expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896069.750315:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896069.750338:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003629952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.750344:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1789896069.750363:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003629952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.750374:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.750383:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.750414:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.750436:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.750454:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c18c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.750485:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630080 00000100:00100000:2.0:1789896069.750490:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630080 00000100:00100000:2.0:1789896069.750515:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:2.0:1789896069.750522:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003630080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.750583:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003630080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.750590:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1789896069.750604:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.750628:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.750659:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.750674:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c18c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896069.750678:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630208 00000100:00100000:2.0:1789896069.750684:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630208 00000100:00100000:2.0:1789896069.750711:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:2.0:1789896069.750716:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003630208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.750794:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003630208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896069.750802:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1789896069.750813:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.751016:0:216614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216614:1876838003630336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.751053:0:216614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.751075:0:216614:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7ff4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.751094:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630336 00000100:00100000:3.0:1789896069.751099:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630336 00000100:00100000:3.0:1789896069.751126:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1789896069.751132:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216614:x1876838003630336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.751243:0:216614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216614:1876838003630336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.751244:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216614:x1876838003630336:12345-0@lo:502:llog_process_th.0 Request processed in 109us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.751255:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1789896069.751286:0:216614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216614:1876838003630464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.751322:0:216614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.751346:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630464 00000100:00100000:2.0:1789896069.751349:0:216614:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45455cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.751352:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630464 00000100:00100000:3.0:1789896069.751379:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:3.0:1789896069.751384:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216614:x1876838003630464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.751448:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216614:x1876838003630464:12345-0@lo:502:llog_process_th.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.751456:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1789896069.751461:0:216614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216614:1876838003630464:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896069.751484:0:216614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:0.0:1789896069.751548:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:0.0:1789896069.751563:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896069.751569:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.751578:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.751586:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789896069.751588:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 218 10000000:01000000:0.0:1789896069.751590:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896069.751604:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.751611:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.751618:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.751631:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.751658:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.751675:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.751691:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630592 00000100:00100000:3.0:1789896069.751696:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630592 00000100:00100000:3.0:1789896069.751721:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1789896069.751727:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003630592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896069.751734:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896069.751756:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a29aa expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.751771:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.751798:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896069.751806:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3c00, rc 0) 00000100:00100000:3.0:1789896069.751842:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003630592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.751848:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1789896069.751874:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.751884:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.751889:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.751923:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.751941:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.751952:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.751961:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630720 00000100:00100000:3.0:1789896069.751966:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630720 00000100:00100000:3.0:1789896069.751989:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:3.0:1789896069.751994:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003630720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.752060:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003630720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.752067:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1789896069.752087:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.752117:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.752147:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.752160:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.752168:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630848 00000100:00100000:3.0:1789896069.752174:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630848 00000100:00100000:3.0:1789896069.752222:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:3.0:1789896069.752229:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003630848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.752296:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003630848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.752303:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:0.0:1789896069.752315:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003630848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896069.752503:0:216615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216615:1876838003630976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.752547:0:216615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896069.752569:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003630976 00000100:00100000:3.0:1789896069.752575:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003630976 00000100:00100000:2.0:1789896069.752578:0:216615:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45455540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.752604:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1789896069.752612:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216615:x1876838003630976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896069.752690:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216615:x1876838003630976:12345-0@lo:502:llog_process_th.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896069.752698:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:2.0:1789896069.752707:0:216615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216615:1876838003630976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896069.752732:0:216615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896069.752752:0:216615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896069.752754:0:216615:0:(obd_config.c:1561:class_process_config()) marker 208 (0x1) lustre-MDT0000-m new lustre.qpool1 00000020:00000080:2.0:1789896069.752760:0:216615:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1789896069.752802:0:216615:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00080000:10000000:2.0:1789896069.753384:0:216615:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5c:0x0] (8/32) registered 00080000:10000000:2.0:1789896069.754761:0:216615:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5d:0x0] (8/32) registered 00080000:10000000:2.0:1789896069.755821:0:216615:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5e:0x0] (8/32) registered 00000100:00100000:2.0:1789896069.756717:0:216615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216615:1876838003631104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896069.756781:0:216615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896069.756806:0:216615:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa41377540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896069.756834:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631104 00000100:00100000:0.0:1789896069.756842:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631104 00000100:00100000:0.0:1789896069.756882:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1789896069.756891:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216615:x1876838003631104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896069.757005:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216615:x1876838003631104:12345-0@lo:502:llog_process_th.0 Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896069.757013:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1789896069.757035:0:216615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216615:1876838003631104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896069.757059:0:216615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896069.757064:0:216615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896069.757065:0:216615:0:(obd_config.c:1561:class_process_config()) marker 208 (0x2) lustre-MDT0000-m new lustre.qpool1 00000040:00080000:2.0:1789896069.757068:0:216615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 221 count 217 00000020:01000000:0.0:1789896069.757137:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 218-220 (rc=0) 10000000:01000000:0.0:1789896069.757161:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789896069.757171:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.757183:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896069.757192:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789896069.757234:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:0.0:1789896069.757237:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789896069.757260:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.757268:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.757277:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.757291:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003631232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.757319:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.757354:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9470c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896069.757366:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631232 00000100:00100000:1.0:1789896069.757372:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631232 00000100:00100000:1.0:1789896069.757404:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:1.0:1789896069.757413:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003631232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896069.757422:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896069.757434:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a29b8 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.757455:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.757468:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896069.757476:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c6c00, rc 0) 00000100:00100000:1.0:1789896069.757522:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003631232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896069.757540:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1789896069.757557:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003631232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896069.757571:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.757581:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896069.757627:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003631360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896069.757653:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896069.757672:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b9470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896069.757690:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631360 00000100:00100000:3.0:1789896069.757695:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631360 00000100:00100000:3.0:1789896069.757722:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:3.0:1789896069.757730:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003631360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896069.757799:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003631360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (145us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896069.757806:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1789896069.757836:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003631360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789896069.757856:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789896069.757861:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896069.757880:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.003602:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896070.003647:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896070.003666:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972480 00000100:00100000:3.0:1789896070.003676:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972480 00000100:00100000:2.0:1789896070.003712:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972352 00000100:00100000:2.0:1789896070.003718:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972352 00000100:00080000:1.0:1789896070.003729:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789896070.003735:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789896070.003768:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 553 00000100:00100000:2.0:1789896070.003777:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 554 00000100:00100000:3.0:1789896070.003790:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2401:x1876838015972480:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896070.003793:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2402:x1876838015972352:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896070.003875:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2402:x1876838015972352:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.003876:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2401:x1876838015972480:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.003891:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 553 00000100:00100000:2.0:1789896070.003897:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 554 00010000:00010000:3.0:1789896070.124443:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896070.572322:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003631488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896070.572322:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003631744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896070.572387:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896070.572388:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003632000:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.572424:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.572430:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876838003632256:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.572449:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003632512:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896070.572473:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.572473:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003631872:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572482:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876838003632768:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.572492:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003633024:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572526:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.572528:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896070.572536:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632000 00000100:00100000:3.0:1789896070.572544:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632000 00000100:00100000:1.0:1789896070.572561:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876838003633280:0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.572565:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003632384:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572597:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896070.572604:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632512 00000100:00100000:2.0:1789896070.572609:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896070.572610:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632512 00000100:00100000:1.0:1789896070.572634:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631744 00000100:00100000:1.0:1789896070.572637:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631744 00000100:00100000:2.0:1789896070.572641:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876838003632896:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.572642:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789896070.572653:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003632000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572664:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789896070.572671:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003631744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789896070.572692:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896070.572718:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896070.572723:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003632000:12345-0@lo:400:kworker.0 Request processed in 68us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.572742:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789896070.572745:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003631744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.572752:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789896070.572764:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789896070.572772:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003632512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572777:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632256 00000100:00100000:1.0:1789896070.572780:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632256 00000100:00100000:2.0:1789896070.572789:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631872 00000100:00100000:2.0:1789896070.572795:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631872 00000100:00100000:3.0:1789896070.572809:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003632512:12345-0@lo:400:kworker.0 Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.572810:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632768 00000100:00100000:1.0:1789896070.572814:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632768 00000100:00100000:3.0:1789896070.572816:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789896070.572837:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632384 00000100:00100000:2.0:1789896070.572842:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632384 00000100:00080000:3.0:1789896070.572844:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789896070.572849:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789896070.572851:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633280 00000100:00100000:1.0:1789896070.572855:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633280 00000100:00100000:3.0:1789896070.572868:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789896070.572875:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003631872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.572879:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789896070.572884:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632896 00000100:00100000:1.0:1789896070.572889:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632896 00000100:00100000:2.0:1789896070.572894:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003632384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572915:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1789896070.572921:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003631872:12345-0@lo:400:kworker.0 Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.572924:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3617:x1876838003632256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.572928:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789896070.572953:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003632384:12345-0@lo:400:kworker.0 Request processed in 63us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.572959:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1789896070.572965:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789896070.572967:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3617:x1876838003632256:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.572968:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3617:x1876838003632768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.572976:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1789896070.572999:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1789896070.573004:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3617:x1876838003632768:12345-0@lo:400:kworker.0 Request processed in 36us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.573006:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1789896070.573012:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876838003633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.573014:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1789896070.573017:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876838003632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.573051:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.573064:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876838003633280:12345-0@lo:400:kworker.0 Request processed in 54us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896070.573072:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1789896070.573076:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003631616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896070.573076:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876838003632896:12345-0@lo:400:kworker.0 Request processed in 60us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.573084:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1789896070.573102:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.573115:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.573117:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631488 00000100:00100000:1.0:1789896070.573121:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631488 00000100:00100000:3.0:1789896070.573126:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003632128:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573147:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003631616 00000100:00100000:1.0:1789896070.573150:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003631616 00000100:00100000:3.0:1789896070.573156:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.573160:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003632000:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573169:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789896070.573178:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003631488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896070.573179:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003632640:0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.573186:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003632512:0@lo:400:kworker.0 00002000:00000024:1.0:1789896070.573220:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896070.573227:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.573235:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003631872:0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.573248:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003632384:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.573250:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003633152:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573260:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003631488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896070.573263:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876838003632896:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573273:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789896070.573276:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.573292:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789896070.573299:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003631616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896070.573306:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633024 00002000:00000024:1.0:1789896070.573310:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896070.573311:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003631488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896070.573311:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633024 00000100:00100000:2.0:1789896070.573339:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633152 00000100:00100000:2.0:1789896070.573342:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633152 00000100:00100000:3.0:1789896070.573346:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632128 00000100:00100000:3.0:1789896070.573352:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632128 00000100:00100000:1.0:1789896070.573352:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003631616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.573359:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789896070.573364:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1789896070.573371:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003633024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.573379:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003632640 00000100:00100000:1.0:1789896070.573382:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789896070.573383:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003632640 00000100:00100000:1.0:1789896070.573391:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003633152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.573407:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003633024:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.573410:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789896070.573417:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1789896070.573423:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003632128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573432:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003633152:12345-0@lo:400:kworker.0 Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.573438:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00010000:00080000:2.0:1789896070.573447:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94d2a8380 x1876838003633024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896070.573458:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003632128:12345-0@lo:400:kworker.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896070.573467:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003633024:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.573469:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1789896070.573478:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789896070.573481:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789896070.573484:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789896070.573486:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789896070.573494:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003632640:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789896070.573512:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94d2ab480 x1876838003633280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789896070.573521:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003632128:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573524:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876838003633280:0@lo:400:kworker.0 00000100:00100000:3.0:1789896070.573529:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003632640:12345-0@lo:400:kworker.0 Request processed in 35us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.573535:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789896070.573543:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003632640:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573545:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876838003632256:0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.573559:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003633152:0@lo:400:kworker.0 00000100:00100000:1.0:1789896070.573566:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876838003632768:0@lo:400:kworker.0 00000100:00100000:2.0:1789896070.573576:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003631616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896070.573591:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003631744:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1789896070.972336:0:216712:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff1026cc40 20000000:00000080:0.0:1789896070.972352:0:216712:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a949ae2000 uarg=0000000000000000 00000040:00100000:0.0:1789896070.972932:0:216712:0:(llog.c:1072:llog_reverse_process()) index 192 : idx 181 20000000:01000000:0.0:1789896070.972938:0:216712:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 191 cmd:0xce020 lustre.qpool1 00000040:00080000:0.0:1789896070.973019:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].193, 224 off43416 20000000:01000000:0.0:1789896070.973037:0:216712:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789896070.973053:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].194, 128 off43544 00000040:00080000:0.0:1789896070.973067:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].195, 224 off43768 00000040:00080000:0.0:1789896070.973116:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].221, 224 off48784 20000000:01000000:0.0:1789896070.973124:0:216712:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789896070.973138:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].222, 136 off48920 00000040:00080000:0.0:1789896070.973162:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].224, 224 off49376 00000040:00080000:0.0:1789896070.973235:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].221, 224 off48784 20000000:01000000:0.0:1789896070.973243:0:216712:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789896070.973255:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].222, 136 off48920 00000040:00080000:0.0:1789896070.973275:0:216712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].224, 224 off49376 10000000:01000000:0.0:1789896070.973286:0:216712:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789896070.973304:0:216712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973324:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973331:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973349:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973355:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973362:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973368:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973375:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973381:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a298e expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973387:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a299c expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973394:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973400:0:216712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973407:0:216712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973450:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973463:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 23 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.973477:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633408:0@lo:104: 00000100:00100000:0.0:1789896070.973533:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.973581:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633408 00010000:00010000:0.0:1789896070.973588:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.973591:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633408 00010000:00010000:0.0:1789896070.973599:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.973608:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633536:0@lo:104: 00000100:00100000:0.0:1789896070.973632:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.973667:0:189482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789896070.973673:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a299c expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.973678:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633536 00000100:00100000:3.0:1789896070.973684:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633536 00010000:00010000:0.0:1789896070.973685:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a299c expref: 23 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.973686:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789896070.973699:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003633408:12345-0@lo:104: 00000100:00100000:0.0:1789896070.973700:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633664:0@lo:104: 00010000:00010000:2.0:1789896070.973715:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.973720:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1789896070.973742:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003633536:12345-0@lo:104: 00000100:00100000:0.0:1789896070.973743:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896070.973754:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973769:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a298e expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.973778:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633664 00010000:00010000:0.0:1789896070.973780:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a298e expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.973784:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633664 00010000:00010000:2.0:1789896070.973788:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789896070.973792:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789896070.973799:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216712:x1876838003633408:12345-0@lo:104: Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.973800:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:216712:x1876838003633536:12345-0@lo:104: Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896070.973808:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633792:0@lo:104: 00000100:00100000:2.0:1789896070.973811:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1789896070.973822:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1789896070.973830:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1789896070.973841:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.973844:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003633664:12345-0@lo:104: 00010000:00010000:1.0:1789896070.973855:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.973862:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633792 00000100:00100000:3.0:1789896070.973867:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633792 00010000:00010000:0.0:1789896070.973875:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973886:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 23 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.973894:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00010000:00010000:2.0:1789896070.973895:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789896070.973898:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633920:0@lo:104: 00010000:00010000:2.0:1789896070.973903:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.973911:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896070.973914:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b400 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:3.0:1789896070.973916:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003633792:12345-0@lo:104: 10000000:00010000:2.0:1789896070.973919:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.973925:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.973930:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003633664:12345-0@lo:104: Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896070.973931:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.973950:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00010000:00010000:2.0:1789896070.973951:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896070.973961:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.973965:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.973971:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003633920 10000000:01000000:2.0:1789896070.973973:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896070.973978:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003633920 00010000:00010000:3.0:1789896070.973980:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789896070.973988:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 23 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.973989:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003633792:12345-0@lo:104: Request processed in 87us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.974002:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789896070.974011:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003634048:0@lo:104: 00010000:00010000:2.0:1789896070.974013:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.974014:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1789896070.974017:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003633920:12345-0@lo:104: 00010000:00010000:2.0:1789896070.974030:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896070.974033:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974035:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896070.974043:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974051:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974052:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ac00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896070.974056:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974059:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a29b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974064:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974067:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896070.974080:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896070.974086:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896070.974086:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896070.974090:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974090:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789896070.974101:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974102:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003633920:12345-0@lo:104: Request processed in 88us (174us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896070.974104:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896070.974111:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974113:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974121:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00010000:00010000:0.0:1789896070.974126:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 23 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974128:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896070.974129:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974140:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634048 00010000:00010000:3.0:1789896070.974147:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974147:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634048 10000000:00010000:2.0:1789896070.974148:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974151:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003634304:0@lo:104: 00010000:00010000:3.0:1789896070.974163:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a29aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29b1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896070.974163:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896070.974164:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1789896070.974178:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003634048:12345-0@lo:104: 00010000:00010000:3.0:1789896070.974179:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896070.974181:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974185:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974190:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896070.974192:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b200 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896070.974192:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974229:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974229:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896070.974230:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974241:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974241:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a299c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a29a3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896070.974248:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896070.974254:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896070.974258:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896070.974262:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974263:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974276:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896070.974279:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ba00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896070.974284:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974285:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974286:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003634048:12345-0@lo:104: Request processed in 109us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.974305:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00010000:00010000:0.0:1789896070.974307:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 23 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974312:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896070.974314:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974322:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974324:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634304 10000000:00010000:2.0:1789896070.974329:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974329:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65b84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003634688:0@lo:104: 00000100:00100000:1.0:1789896070.974330:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634304 00010000:00010000:3.0:1789896070.974332:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a298e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2995 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896070.974341:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896070.974347:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896070.974350:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974356:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ae00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896070.974359:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974366:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974367:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974371:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00010000:00010000:2.0:1789896070.974380:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896070.974380:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789896070.974382:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974386:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003634304:12345-0@lo:104: 00010000:00010000:2.0:1789896070.974393:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896070.974397:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896070.974406:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974407:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a2980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2987 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974409:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974422:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974432:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896070.974433:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 23 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974437:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896070.974441:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896070.974448:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896070.974452:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003635072:0@lo:104: 00010000:00010000:3.0:1789896070.974456:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.974457:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003634176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896070.974469:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789896070.974476:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ae00/0x412fd4b3617a2972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2979 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974481:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003634304:12345-0@lo:104: Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.974491:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789896070.974502:0:216712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.974508:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.974509:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634688 00000100:00100000:1.0:1789896070.974515:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634688 00010000:00010000:0.0:1789896070.974528:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.974539:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 9 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.974540:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003634944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896070.974541:0:200085:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789896070.974556:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003635072 00000100:00100000:0.0:1789896070.974559:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003635328:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896070.974561:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003635072 00000100:00100000:2.0:1789896070.974575:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.974587:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1789896070.974595:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003634688:12345-0@lo:104: 00010000:00010000:1.0:1789896070.974602:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.974608:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789896070.974617:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003634816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896070.974624:0:216712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.974635:0:216712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 9 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974645:0:216712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003635456:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896070.974648:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789896070.974653:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896070.974659:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:216712:x1876838003634688:12345-0@lo:104: Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.974675:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1789896070.974686:0:216712:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896070.974691:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634176 00010000:00010000:3.0:1789896070.974693:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789896070.974696:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1789896070.974697:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634176 00010000:00010000:3.0:1789896070.974698:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974705:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5be00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896070.974708:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94f46e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003635072:12345-0@lo:104: 00000100:00100000:0.0:1789896070.974710:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633408:0@lo:104: 10000000:00010000:3.0:1789896070.974711:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974720:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 24 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974721:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974724:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974740:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633536:0@lo:104: 10000000:00010000:3.0:1789896070.974756:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974760:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633664:0@lo:104: 00000100:00100000:2.0:1789896070.974761:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634944 00000100:00100000:2.0:1789896070.974765:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634944 10000000:01000000:3.0:1789896070.974767:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896070.974780:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633792:0@lo:104: 00010000:00010000:2.0:1789896070.974782:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 25 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974784:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789896070.974792:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.974796:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94f46e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:216712:x1876838003635072:12345-0@lo:104: Request processed in 89us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896070.974801:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896070.974808:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634816 00000100:00100000:0.0:1789896070.974809:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003633920:0@lo:104: 00000100:00100000:2.0:1789896070.974813:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634816 00000100:00100000:1.0:1789896070.974815:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00010000:00010000:3.0:1789896070.974817:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974823:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003634048:0@lo:104: 00010000:00010000:3.0:1789896070.974831:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a2964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a296b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974831:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a298e expref: 26 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974841:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003634304:0@lo:104: 00010000:00010000:3.0:1789896070.974845:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896070.974853:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974855:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65b84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003634688:0@lo:104: 00010000:00010000:1.0:1789896070.974857:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896070.974867:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896070.974867:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896070.974874:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.974874:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1789896070.974875:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003635072:0@lo:104: 00000100:00100000:2.0:1789896070.974886:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3618:x1876838003634176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896070.974888:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a000 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896070.974891:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896070.974894:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974898:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:3.0:1789896070.974901:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974905:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 26 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974911:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.974911:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789896070.974923:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896070.974923:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 26 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.974924:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789896070.974926:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896070.974941:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896070.974946:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.974947:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6c00/0x412fd4b3617a29bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a29b8 expref: 26 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.974954:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896070.974955:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00010000:00010000:2.0:1789896070.974962:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896070.974962:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.974969:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003634944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896070.974970:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.974974:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896070.974985:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a295d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.974986:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896070.974988:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.974992:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003634176:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (485us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896070.974996:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 25 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.975007:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896070.975009:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00010000:00010000:3.0:1789896070.975011:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896070.975011:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a294f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.975014:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896070.975022:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 24 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.975023:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896070.975028:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00010000:00010000:1.0:1789896070.975032:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896070.975037:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003634432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896070.975038:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896070.975039:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003634816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896070.975043:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896070.975043:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2980 expref: 24 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.975048:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896070.975057:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a298e expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.975059:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896070.975065:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896070.975069:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a298e expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.975081:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a298e expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.975090:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634432 00000100:00100000:0.0:1789896070.975098:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003634944:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.975101:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003635200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896070.975101:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896070.975103:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634432 00000100:00100000:0.0:1789896070.975114:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00010000:00010000:1.0:1789896070.975126:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.975130:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.975133:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003634816:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896070.975148:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1789896070.975151:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003635200 00000100:00100000:3.0:1789896070.975152:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789896070.975158:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003635200 00000100:00100000:3.0:1789896070.975162:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003634560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896070.975168:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00010000:00010000:0.0:1789896070.975176:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 22 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.975181:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003634432:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896070.975191:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896070.975219:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896070.975226:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 22 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.975235:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003634560 00010000:00010000:1.0:1789896070.975239:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 22 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.975241:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003634560 00000100:00100000:0.0:1789896070.975246:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1789896070.975256:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003635584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896070.975257:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a299c expref: 23 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.975261:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a29b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a29aa expref: 23 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.975262:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003635200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896070.975280:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896070.975283:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896070.975288:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896070.975288:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 22 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.975291:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1789896070.975302:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003634560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896070.975304:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 22 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.975314:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896070.975322:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6800/0x412fd4b3617a2979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2972 expref: 22 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.975323:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a299c expref: 22 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.975329:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3615:x1876838003634432:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.975349:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00010000:00010000:2.0:1789896070.975352:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a299c expref: 21 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.975360:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896070.975365:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003635584 00010000:00010000:2.0:1789896070.975367:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a299c expref: 20 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.975370:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003635584 00010000:00010000:2.0:1789896070.975380:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896070.975393:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003635200:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896070.975401:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00010000:00010000:1.0:1789896070.975405:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 20 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.975415:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3615:x1876838003634560:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896070.975424:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1789896070.975431:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1789896070.975435:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95352f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3615:x1876838003635584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896070.975444:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896070.975449:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 18 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.975468:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 18 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.975474:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003635712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896070.975482:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a296b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2964 expref: 18 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.975492:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896070.975501:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896070.975521:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95352f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3615:x1876838003635584:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896070.975532:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789896070.975540:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003635840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896070.975562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896070.975585:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003635712 00000100:00100000:2.0:1789896070.975589:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003635712 00010000:00010000:2.0:1789896070.975602:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 18 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.975615:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003635840 00000100:00100000:3.0:1789896070.975618:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003635840 00010000:00010000:3.0:1789896070.975629:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 19 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.975832:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1789896070.975856:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1789896070.975862:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1789896070.975866:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003635712:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896070.975870:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003635840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896070.975875:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896070.975875:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896070.975881:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 18 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.975881:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 18 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.975890:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 18 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.975894:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003634816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896070.975903:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 18 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.975910:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003634176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896070.975919:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003634944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896070.976050:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a294f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2948 expref: 18 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896070.976060:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896070.976094:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3617:x1876838003635840:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896070.976100:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1789896070.976124:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003635840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896070.976125:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a295d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2956 expref: 16 pid: 188725 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896070.976139:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003634560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896070.976142:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896070.976150:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003635584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896070.976159:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003634432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896070.976167:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003635200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896070.976177:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3617:x1876838003635712:12345-0@lo:103:ldlm_bl.0 Request processed in 314us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896070.976184:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1789896070.976238:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003635712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896070.976723:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003635328:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789896070.976744:0:216712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216712:1876838003635456:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896070.976772:0:216712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.977242:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896070.977283:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896070.977307:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972608 00000100:00100000:1.0:1789896070.977313:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972608 00010000:00010000:1.0:1789896070.977333:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 10 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896070.977339:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972736 00000100:00100000:2.0:1789896070.977344:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972736 00010000:00010000:2.0:1789896070.977358:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 11 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.977368:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 603 00000100:00100000:1.0:1789896070.977376:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9524d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015972608:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789896070.977382:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 604 00010000:00010000:1.0:1789896070.977385:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896070.977391:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 11 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896070.977397:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9524d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015972736:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789896070.977403:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 11 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977408:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896070.977415:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b7 expref: 11 pid: 188726 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977417:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 11 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896070.977427:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896070.977441:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 10 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896070.977463:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9524d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015972608:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896070.977472:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 603 00010000:00010000:0.0:1789896070.977473:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a293a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6b0 expref: 10 pid: 188723 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977488:0:198252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977496:0:198252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977510:0:198252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977517:0:198252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977525:0:198252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977531:0:198252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977537:0:198252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a400 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:0.0:1789896070.977541:0:198252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977548:0:198252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977566:0:198252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896070.977585:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896070.977614:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9524d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015972736:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 223us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896070.977621:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 604 00010000:00010000:2.0:1789896070.977696:0:216712:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.977710:0:216712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896070.977716:0:216712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a29c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896071.108295:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896071.108302:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 193 10000000:01000000:1.0:1789896071.108306:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896071.108351:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.108377:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.108389:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.108413:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003635968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.108475:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.108517:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896071.108548:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003635968 00000100:00100000:2.0:1789896071.108559:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003635968 00000100:00100000:2.0:1789896071.108618:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1789896071.108627:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003635968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896071.108642:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896071.108653:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a29cd expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.108684:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a29cd expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.108696:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a29d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29cd expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.108706:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896071.108760:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003635968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896071.108769:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:1.0:1789896071.108788:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003635968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896071.108802:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29d4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.108809:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29d4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.108865:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.108883:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.108901:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.108924:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636096 00000100:00100000:3.0:1789896071.108928:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636096 00000100:00100000:3.0:1789896071.108953:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1789896071.108958:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003636096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.109069:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003636096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.109076:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:1.0:1789896071.109110:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.109141:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.109181:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896071.109228:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636224 00000100:00100000:1.0:1789896071.109229:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896071.109233:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636224 00000100:00100000:2.0:1789896071.109266:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1789896071.109273:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003636224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896071.109356:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003636224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896071.109362:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:1.0:1789896071.109389:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.109798:0:216713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216713:1876838003636352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.109832:0:216713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.109849:0:216713:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.109864:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636352 00000100:00100000:3.0:1789896071.109868:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636352 00000100:00100000:3.0:1789896071.109889:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:3.0:1789896071.109897:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216713:x1876838003636352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.109966:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216713:x1876838003636352:12345-0@lo:502:llog_process_th.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.109971:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:1.0:1789896071.109990:0:216713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216713:1876838003636352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.110027:0:216713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216713:1876838003636480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.110058:0:216713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.110081:0:216713:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.110086:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636480 00000100:00100000:3.0:1789896071.110090:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636480 00000100:00100000:3.0:1789896071.110110:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1789896071.110114:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216713:x1876838003636480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.110163:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:216713:x1876838003636480:12345-0@lo:502:llog_process_th.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.110174:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1789896071.110178:0:216713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216713:1876838003636480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896071.110213:0:216713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:0.0:1789896071.110285:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:0.0:1789896071.110314:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896071.110321:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29d4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.110332:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a29cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29d4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896071.110340:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789896071.110342:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 41 10000000:01000000:0.0:1789896071.110344:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896071.110360:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.110367:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.110374:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.110387:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.110414:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.110438:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.110450:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636608 00000100:00100000:3.0:1789896071.110455:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636608 00000100:00100000:3.0:1789896071.110478:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1789896071.110484:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003636608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.110490:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.110498:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a29e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a29db expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.110512:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a29e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a29db expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.110519:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a29e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29db expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.110525:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3600, rc 0) 00000100:00100000:3.0:1789896071.110553:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003636608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.110558:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1789896071.110587:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896071.110614:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29e2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.110622:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29e2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.110667:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.110691:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.110706:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.110737:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636736 00000100:00100000:3.0:1789896071.110741:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636736 00000100:00100000:3.0:1789896071.110762:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:3.0:1789896071.110767:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003636736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.110828:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003636736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.110832:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1789896071.110862:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.110884:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.110915:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.110931:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.110951:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636864 00000100:00100000:3.0:1789896071.110962:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636864 00000100:00100000:3.0:1789896071.110987:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:3.0:1789896071.110994:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003636864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.111071:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003636864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.111078:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:0.0:1789896071.111109:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896071.111781:0:216714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 41 00000020:01000000:1.0:1789896071.111839:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 41-40 (rc=0) 10000000:01000000:1.0:1789896071.111859:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789896071.111864:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29e2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.111870:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a29db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29e2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896071.111875:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896071.111876:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 193 10000000:01000000:1.0:1789896071.111877:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896071.111888:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.111892:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.111897:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.111911:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.111929:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.111950:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.112133:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003636992 00000100:00100000:3.0:1789896071.112136:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003636992 00000100:00100000:3.0:1789896071.112160:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:3.0:1789896071.112167:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003636992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.112174:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.112183:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a29f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a29e9 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.112213:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a29f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a29e9 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.112220:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a29f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29e9 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.112225:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3a00, rc 0) 00000100:00100000:1.0:1789896071.112268:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003636992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.112270:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003636992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (337us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896071.112278:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29f0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896071.112279:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00010000:00010000:1.0:1789896071.112288:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29f0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.112316:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.112333:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.112357:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.112368:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637120 00000100:00100000:3.0:1789896071.112372:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637120 00000100:00100000:3.0:1789896071.112393:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:3.0:1789896071.112397:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003637120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.112464:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003637120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.112469:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1789896071.112498:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.112522:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.112554:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.112573:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.112603:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637248 00000100:00100000:3.0:1789896071.112608:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637248 00000100:00100000:3.0:1789896071.112637:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1789896071.112644:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003637248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.112711:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003637248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.112718:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1789896071.112743:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.112929:0:216715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216715:1876838003637376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.112960:0:216715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.112977:0:216715:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.113009:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637376 00000100:00100000:3.0:1789896071.113015:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637376 00000100:00100000:3.0:1789896071.113042:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1789896071.113049:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216715:x1876838003637376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.113131:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216715:x1876838003637376:12345-0@lo:502:llog_process_th.0 Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.113139:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1789896071.113154:0:216715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216715:1876838003637376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.113185:0:216715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216715:1876838003637504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.113230:0:216715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.113259:0:216715:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.113274:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637504 00000100:00100000:3.0:1789896071.113279:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637504 00000100:00100000:3.0:1789896071.113308:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:3.0:1789896071.113314:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216715:x1876838003637504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.113382:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:216715:x1876838003637504:12345-0@lo:502:llog_process_th.0 Request processed in 67us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.113389:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:1.0:1789896071.113397:0:216715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216715:1876838003637504:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896071.113426:0:216715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:0.0:1789896071.113492:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:0.0:1789896071.113508:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896071.113514:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29f0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.113522:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6600/0x412fd4b3617a29e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29f0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896071.113529:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789896071.113531:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 44 10000000:01000000:0.0:1789896071.113534:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896071.113548:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.113560:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.113569:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.113583:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.113610:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.113628:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.113659:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637632 00000100:00100000:3.0:1789896071.113664:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637632 00000100:00100000:3.0:1789896071.113697:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:3.0:1789896071.113704:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003637632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.113711:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.113721:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a29fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a29f7 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.113751:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a29fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a29f7 expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.113760:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a29fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a29f7 expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.113767:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2400, rc 0) 00000100:00100000:3.0:1789896071.113799:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003637632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.113806:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1789896071.113830:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896071.113843:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29fe expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.113852:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a29fe expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.113891:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.113915:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.113934:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.113953:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637760 00000100:00100000:3.0:1789896071.113957:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637760 00000100:00100000:3.0:1789896071.113977:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:3.0:1789896071.113981:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003637760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.114033:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003637760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.114038:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1789896071.114065:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.114095:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.114130:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.114147:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.114156:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003637888 00000100:00100000:3.0:1789896071.114160:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003637888 00000100:00100000:3.0:1789896071.114175:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1789896071.114179:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003637888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.114247:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003637888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.114259:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:0.0:1789896071.114273:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003637888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896071.115030:0:216716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 44 00000020:01000000:1.0:1789896071.115158:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 44-43 (rc=0) 10000000:01000000:1.0:1789896071.115173:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789896071.115178:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29fe expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.115187:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a29f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a29fe expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896071.115192:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896071.115194:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 193 10000000:01000000:1.0:1789896071.115195:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896071.115235:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.115240:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.115247:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.115261:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.115288:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.115313:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.115316:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638016 00000100:00100000:3.0:1789896071.115320:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638016 00000100:00100000:3.0:1789896071.115342:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1789896071.115348:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003638016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.115353:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.115367:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a2a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2a05 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.115381:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a2a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2a05 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.115390:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a2a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2a05 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.115398:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3800, rc 0) 00000100:00100000:3.0:1789896071.115427:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003638016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.115431:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1789896071.115451:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896071.115469:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a0c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.115477:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2a0c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.115517:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.115539:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.115559:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.115569:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638144 00000100:00100000:3.0:1789896071.115573:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638144 00000100:00100000:3.0:1789896071.115591:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1789896071.115594:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003638144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.115643:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003638144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.115648:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1789896071.115667:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.115689:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.115717:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.115745:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.115749:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638272 00000100:00100000:3.0:1789896071.115758:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638272 00000100:00100000:3.0:1789896071.115777:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:3.0:1789896071.115781:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003638272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.115828:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003638272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.115834:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1789896071.115843:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.116034:0:216717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216717:1876838003638400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.116058:0:216717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.116071:0:216717:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.116103:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638400 00000100:00100000:3.0:1789896071.116108:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638400 00000100:00100000:3.0:1789896071.116128:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1789896071.116134:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216717:x1876838003638400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.116233:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216717:x1876838003638400:12345-0@lo:502:llog_process_th.0 Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.116239:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:1.0:1789896071.116343:0:216717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216717:1876838003638400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.116369:0:216717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216717:1876838003638528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.116390:0:216717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.116408:0:216717:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.116431:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638528 00000100:00100000:3.0:1789896071.116435:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638528 00000100:00100000:3.0:1789896071.116454:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1789896071.116459:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216717:x1876838003638528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.116511:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:216717:x1876838003638528:12345-0@lo:502:llog_process_th.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.116517:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1789896071.116532:0:216717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216717:1876838003638528:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896071.116555:0:216717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:0.0:1789896071.116616:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:0.0:1789896071.116640:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896071.116644:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a0c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.116656:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a2a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a0c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896071.116663:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789896071.116666:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 221 10000000:01000000:0.0:1789896071.116668:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896071.116682:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.116689:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.116696:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.116708:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.116749:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.116767:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.116787:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638656 00000100:00100000:3.0:1789896071.116792:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638656 00000100:00100000:3.0:1789896071.116816:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1789896071.116823:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003638656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.116828:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.116835:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a2a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2a13 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.116851:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a2a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2a13 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.116860:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a2a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2a13 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.116867:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3200, rc 0) 00000100:00100000:3.0:1789896071.116898:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003638656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.116903:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1789896071.116925:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896071.116937:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a1a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.116943:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2a1a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.116978:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.116995:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.117008:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.117034:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638784 00000100:00100000:3.0:1789896071.117039:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638784 00000100:00100000:3.0:1789896071.117062:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1789896071.117067:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003638784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.117120:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003638784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.117126:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1789896071.117147:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.117171:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.117222:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896071.117249:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003638912 00000100:00100000:3.0:1789896071.117253:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003638912 00000100:00100000:0.0:1789896071.117263:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.117282:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1789896071.117289:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003638912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.117347:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003638912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.117354:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1789896071.117383:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003638912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.117589:0:216718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216718:1876838003639040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896071.117622:0:216718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.117640:0:216718:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.117657:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639040 00000100:00100000:3.0:1789896071.117661:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639040 00000100:00100000:3.0:1789896071.117687:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1789896071.117691:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216718:x1876838003639040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.117772:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216718:x1876838003639040:12345-0@lo:502:llog_process_th.0 Request processed in 80us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.117778:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:0.0:1789896071.117802:0:216718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216718:1876838003639040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896071.117833:0:216718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896071.117842:0:216718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896071.117844:0:216718:0:(obd_config.c:1561:class_process_config()) marker 212 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:0.0:1789896071.117850:0:216718:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789896071.117866:0:216718:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 1 00000100:00100000:0.0:1789896071.117879:0:216718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216718:1876838003639168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896071.117909:0:216718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.117927:0:216718:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.117944:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639168 00000100:00100000:3.0:1789896071.117948:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639168 00000100:00100000:3.0:1789896071.117970:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:3.0:1789896071.117974:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216718:x1876838003639168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.118020:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216718:x1876838003639168:12345-0@lo:502:llog_process_th.0 Request processed in 45us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.118024:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1789896071.118042:0:216718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216718:1876838003639168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896071.118077:0:216718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216718:1876838003639296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896071.118115:0:216718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.118132:0:216718:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b947180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.118143:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639296 00000100:00100000:3.0:1789896071.118148:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639296 00000100:00100000:3.0:1789896071.118171:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1789896071.118178:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216718:x1876838003639296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.118258:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:216718:x1876838003639296:12345-0@lo:502:llog_process_th.0 Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.118265:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1789896071.118272:0:216718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216718:1876838003639296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896071.118297:0:216718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896071.118301:0:216718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896071.118311:0:216718:0:(obd_config.c:1561:class_process_config()) marker 212 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789896071.118316:0:216718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 225 count 220 00000020:01000000:1.0:1789896071.118372:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 221-224 (rc=0) 10000000:01000000:1.0:1789896071.118390:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789896071.118394:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a1a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.118401:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a2a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a1a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896071.118407:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896071.118408:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 193 10000000:01000000:1.0:1789896071.118410:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896071.118420:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.118425:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.118430:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.118438:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003639424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.118456:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.118474:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.118484:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639424 00000100:00100000:3.0:1789896071.118488:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639424 00000100:00100000:3.0:1789896071.118510:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:3.0:1789896071.118515:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003639424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.118521:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.118528:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2a21 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.118549:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2a21 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.118557:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a2a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2a21 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.118563:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2c00, rc 0) 00000100:00100000:3.0:1789896071.118589:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003639424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.118595:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1789896071.118614:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003639424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896071.118626:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a28 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.118634:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2a28 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.118693:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003639552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.118718:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896071.118749:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639552 00000100:00100000:1.0:1789896071.118750:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.118754:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639552 00000100:00100000:3.0:1789896071.118776:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1789896071.118782:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003639552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.118842:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003639552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.118849:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1789896071.118853:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003639552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.118875:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003639680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.118899:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.118910:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.118920:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639680 00000100:00100000:3.0:1789896071.118924:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639680 00000100:00100000:3.0:1789896071.118952:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1789896071.118958:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003639680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.119018:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003639680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.119022:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1789896071.119038:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003639680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.119253:0:216719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216719:1876838003639808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.119277:0:216719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.119297:0:216719:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.119301:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639808 00000100:00100000:3.0:1789896071.119305:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639808 00000100:00100000:3.0:1789896071.119331:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1789896071.119334:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216719:x1876838003639808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.119401:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216719:x1876838003639808:12345-0@lo:502:llog_process_th.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.119409:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1789896071.119410:0:216719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216719:1876838003639808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.119439:0:216719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216719:1876838003639936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896071.119461:0:216719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.119472:0:216719:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.119487:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003639936 00000100:00100000:3.0:1789896071.119492:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003639936 00000100:00100000:3.0:1789896071.119517:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1789896071.119524:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216719:x1876838003639936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.119570:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:216719:x1876838003639936:12345-0@lo:502:llog_process_th.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.119575:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1789896071.119590:0:216719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216719:1876838003639936:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896071.119608:0:216719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:0.0:1789896071.119671:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:0.0:1789896071.119690:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896071.119696:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a28 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.119705:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6000/0x412fd4b3617a2a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a28 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896071.119712:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789896071.119714:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 221 10000000:01000000:0.0:1789896071.119716:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896071.119744:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.119752:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.119760:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.119772:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.119795:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.119813:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.119835:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640064 00000100:00100000:3.0:1789896071.119840:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640064 00000100:00100000:3.0:1789896071.119864:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1789896071.119871:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003640064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.119878:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.119884:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2a2f expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.119893:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2a2f expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.119898:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2a2f expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.119905:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2800, rc 0) 00000100:00100000:3.0:1789896071.119937:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003640064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.119949:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1789896071.119955:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896071.119964:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a36 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896071.119970:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2a36 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896071.120000:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.120017:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.120027:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.120043:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640192 00000100:00100000:3.0:1789896071.120048:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640192 00000100:00100000:3.0:1789896071.120072:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1789896071.120080:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003640192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.120134:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003640192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.120141:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:0.0:1789896071.120160:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.120178:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.120244:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.120274:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.120276:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640320 00000100:00100000:3.0:1789896071.120281:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640320 00000100:00100000:3.0:1789896071.120306:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1789896071.120312:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003640320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.120375:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003640320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.120382:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:0.0:1789896071.120402:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896071.120603:0:216720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216720:1876838003640448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896071.120630:0:216720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896071.120647:0:216720:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa484bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.120667:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640448 00000100:00100000:3.0:1789896071.120672:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640448 00000100:00100000:3.0:1789896071.120696:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1789896071.120705:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216720:x1876838003640448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.120784:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216720:x1876838003640448:12345-0@lo:502:llog_process_th.0 Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.120792:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:0.0:1789896071.120803:0:216720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a9524d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216720:1876838003640448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896071.120827:0:216720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896071.120834:0:216720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896071.120836:0:216720:0:(obd_config.c:1561:class_process_config()) marker 211 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:0.0:1789896071.120840:0:216720:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789896071.120849:0:216720:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 1 00000020:01000004:0.0:1789896071.121133:0:216721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789896071.121143:0:216721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:2.0:1789896071.121145:0:216720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216720:1876838003640576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896071.121183:0:216720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896071.121234:0:216720:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa429e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.121244:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640576 00000100:00100000:3.0:1789896071.121256:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640576 00000100:00100000:3.0:1789896071.121289:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1789896071.121297:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216720:x1876838003640576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.121378:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216720:x1876838003640576:12345-0@lo:502:llog_process_th.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.121386:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1789896071.121398:0:216720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216720:1876838003640576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896071.121427:0:216720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216720:1876838003640704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896071.121453:0:216720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896071.121471:0:216720:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe11f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.121481:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640704 00000100:00100000:3.0:1789896071.121485:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640704 00000100:00100000:3.0:1789896071.121503:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1789896071.121508:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216720:x1876838003640704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896071.121555:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:216720:x1876838003640704:12345-0@lo:502:llog_process_th.0 Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.121561:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1789896071.121578:0:216720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:216720:1876838003640704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896071.121602:0:216720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896071.121608:0:216720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896071.121609:0:216720:0:(obd_config.c:1561:class_process_config()) marker 211 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789896071.121613:0:216720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 225 count 220 00000020:01000000:1.0:1789896071.121675:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 221-224 (rc=0) 10000000:01000000:1.0:1789896071.121694:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789896071.121698:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a36 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.121711:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a36 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896071.121715:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789896071.121716:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:1.0:1789896071.121718:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789896071.121740:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.121745:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.121750:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.121758:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.121781:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.121793:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.121818:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640832 00000100:00100000:3.0:1789896071.121824:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640832 00000100:00100000:3.0:1789896071.121848:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1789896071.121853:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003640832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.121860:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.121867:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2a3d expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.121881:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2a3d expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.121888:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2a3d expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.121895:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3c00, rc 0) 00000100:00100000:3.0:1789896071.121928:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003640832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.121942:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1789896071.121944:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896071.121954:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a44 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.121959:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2a44 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896071.121986:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896071.122002:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896071.122020:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896071.122030:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003640960 00000100:00100000:3.0:1789896071.122035:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003640960 00000100:00100000:3.0:1789896071.122057:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1789896071.122065:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003640960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.122112:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003640960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 49us (107us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896071.122120:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1789896071.122131:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94a4cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003640960:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789896071.122151:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789896071.122155:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a44 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896071.122160:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2a44 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.148318:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896071.475735:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896071.475791:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972864 00000100:00100000:3.0:1789896071.475802:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972864 00000100:00100000:3.0:1789896071.475858:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2568 00000100:00100000:3.0:1789896071.475869:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015972864:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896071.475886:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896071.475904:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f6be expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.475932:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6be expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.475944:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6be expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896071.475953:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3e00, rc 0) 00000100:00100000:3.0:1789896071.476008:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015972864:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.476015:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2568 00000100:00100000:1.0:1789896071.476880:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896071.476925:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015972992 00000100:00100000:3.0:1789896071.476929:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015972992 00000100:00100000:3.0:1789896071.476956:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2569 00000100:00100000:3.0:1789896071.476962:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015972992:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.477085:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015972992:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 122us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.477092:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2569 00000100:00100000:0.0:1789896071.477713:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896071.477753:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973120 00000100:00100000:3.0:1789896071.477757:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973120 00000100:00100000:3.0:1789896071.477778:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2570 00000100:00100000:3.0:1789896071.477782:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015973120:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.477848:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015973120:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.477853:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2570 00000100:00100000:0.0:1789896071.478781:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896071.478811:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973248 00000100:00100000:3.0:1789896071.478817:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973248 00000100:00100000:2.0:1789896071.478866:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2571 00000100:00100000:2.0:1789896071.478884:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:215581:x1876838015973248:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896071.478959:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:215581:x1876838015973248:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896071.478964:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2571 00000100:00100000:1.0:1789896071.479579:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896071.479607:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973376 00000100:00100000:3.0:1789896071.479610:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973376 00000100:00100000:3.0:1789896071.479631:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2572 00000100:00100000:3.0:1789896071.479636:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:215581:x1876838015973376:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789896071.479685:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:215581:x1876838015973376:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.479689:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2572 00000100:00100000:0.0:1789896071.480442:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896071.480480:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973504 00000100:00100000:2.0:1789896071.480484:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973504 00000100:00100000:2.0:1789896071.480514:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2573 00000100:00100000:2.0:1789896071.480527:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015973504:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896071.480535:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896071.480547:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f6c5 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.480565:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6c5 expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.480572:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f6c5 expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896071.480579:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9e00, rc 0) 00000100:00100000:2.0:1789896071.480602:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015973504:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896071.480606:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2573 00000100:00100000:0.0:1789896071.481144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896071.481169:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973632 00000100:00100000:3.0:1789896071.481173:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973632 00000100:00100000:3.0:1789896071.481191:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2574 00000100:00100000:3.0:1789896071.481231:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015973632:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896071.481311:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015973632:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 81us (167us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896071.481316:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2574 00000100:00100000:2.0:1789896071.596441:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789896071.596464:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003641088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789896071.596544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896071.596584:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003641088 00000100:00100000:3.0:1789896071.596592:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003641088 00000100:00100000:3.0:1789896071.596647:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789896071.596658:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003641088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789896071.596690:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789896071.596766:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003641088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896071.596775:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789896071.596807:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003641088:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789896072.172419:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896072.329134:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896072.329189:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973760 00000100:00100000:3.0:1789896072.329214:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973760 00000100:00080000:1.0:1789896072.329297:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789896072.329329:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2817 00000100:00100000:3.0:1789896072.329341:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215602:x1876838015973760:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:3.0:1789896072.330557:0:213600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:213600:1876838003641216:0@lo:19:mdt00_005.0 00000100:00100000:3.0:1789896072.330608:0:213600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896072.330641:0:213600:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa43720cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896072.330652:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003641216 00000100:00100000:0.0:1789896072.330658:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003641216 00000100:00080000:1.0:1789896072.330696:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789896072.330710:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789896072.330735:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:213600:x1876838003641216:12345-0@lo:19:mdt00_005.0 00000100:00100000:0.0:1789896072.330900:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:213600:x1876838003641216:12345-0@lo:19:mdt00_005.0 Request processed in 168us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896072.330908:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789896072.330956:0:213600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:213600:1876838003641216:0@lo:19:mdt00_005.0 00000100:00100000:3.0:1789896072.331032:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215602:x1876838015973760:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1693us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896072.331041:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2817 00000100:00100000:0.0:1789896072.332386:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896072.332422:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015973888 00000100:00100000:1.0:1789896072.332428:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015973888 00000100:00100000:1.0:1789896072.332461:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2818 00000100:00100000:1.0:1789896072.332467:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9524d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215602:x1876838015973888:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896072.334018:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9524d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215602:x1876838015973888:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1548us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896072.334028:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2818 00000100:00100000:1.0:1789896072.620332:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789896072.620354:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003641344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789896072.620427:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896072.620464:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003641344 00000100:00100000:2.0:1789896072.620471:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003641344 00000100:00080000:1.0:1789896072.620509:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789896072.620523:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789896072.620531:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003641344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789896072.620556:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896072.620596:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003641344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896072.620601:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789896072.620635:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003641344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789896072.621303:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003641472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789896072.621341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896072.621383:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003641472 00000100:00100000:3.0:1789896072.621388:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003641472 00000100:00100000:3.0:1789896072.621425:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789896072.621434:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003641472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789896072.621455:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:3.0:1789896072.621495:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003641472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896072.621500:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789896072.621525:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003641472:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789896073.196317:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789896073.219160:0:216869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3945526959071ns, next at 3819238265902ns, rc = 0 00080000:00080000:0.0:1789896073.219179:0:216869:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789896073.219324:0:216869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3945527124674ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789896073.219331:0:216869:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789896073.219415:0:216869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3945527215799ns, next at 3746909153849ns, rc = 0 00080000:00080000:0.0:1789896073.219421:0:216869:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789896073.219490:0:216869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3945527290646ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789896073.219496:0:216869:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789896073.219970:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000004:00080000:2.0:1789896073.219978:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 38 committed 00000004:00080000:3.0:1789896073.220470:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000004:00080000:3.0:1789896073.221262:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 38 committed 00000100:00100000:0.0:1789896073.661548:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896073.661586:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015974016 00000100:00100000:2.0:1789896073.661595:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015974016 00000100:00100000:2.0:1789896073.661644:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2819 00000100:00100000:2.0:1789896073.661653:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9524d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215792:x1876838015974016:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896073.661753:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9524d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215792:x1876838015974016:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 102us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896073.661760:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2819 00000100:00100000:3.0:1789896073.669955:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896073.670001:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015974144 00000100:00100000:2.0:1789896073.670010:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015974144 00000100:00100000:2.0:1789896073.670058:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2820 00000100:00100000:2.0:1789896073.670070:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215794:x1876838015974144:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896073.670167:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:215794:x1876838015974144:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 101us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896073.670173:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2820 00000001:02000400:0.0:1789896074.163237:0:216966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_72: @@@@@@ FAIL: Used space(10240) for user quota_usr isn't 0. 00010000:00010000:3.0:1789896074.220343:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 10287 lines, 10287 kept, 0 dropped, 0 bad.